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Abstract 


Supernumerary robotic limbs are a recently introduced class of wearable robots that, differently from 
traditional prostheses and exoskeletons, aim at adding extra arms, legs, or fingers to the human user, 
rather than substituting or enhancing the natural ones. The additional robotic limbs could let the human to 
augment their abilities and could give support in everyday tasks. The advantage of using supernumerary 
robotic devices is twofold. From one side, this addition can enable humans to augment their capabilities, 
see figure la. In the other side, extra limbs can compensate the missing abilities of impaired limbs, e.g., 
in case of stroke patients as shown in figure lb. These wearable robots are aimed to augment not only 
the strength and the precision of the human users, but also their range of skills and interactions with the 
environment. Since supernumerary robotic limbs are supposed to closely interact and perform actions in 
synergy with the human limbs, the control principles of robotic devices and their structure should have 
similar behavior as human’s ones. 



(a) Bonilla, B.L. et al [1] (b) Hussain.I et al. [2] 


Figure 1: Supernumerary robotic limbs: the extra-robotic arms and fingers to augment and compensate the abilities of 
natural limbs 

The objective of this thesis is to lay the foundations of a novel approach to human-robot interaction, ex¬ 
ploiting the emerging field of supernumerary robotic limbs in enhancing and compensating the capabilities 
of natural limbs. The idea of supernumerary limbs is ground breaking because the concept is novel and 
cannot be framed in any of the current areas of robotics. For example, the extra-finger(s) proposed in this 
thesis, augments the manipulation capability of the paretic limb without relying on the subject’s skeletal 
structure (in contrast to exoskeletons), making anatomical variation and motion restriction a minor issue. 
Moreover, the extra-finger is highly wearable and can be even transformed into a bracelet when not in use. 
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The challenge lies not only in the design and development of these devices but also their integration with 
human body through the sensorimotor interfaces to enable user feeling the robot effectively, as a sort of 
natural extension of their sensorimotor abilities. 

In this direction, this thesis contributes in proposing new generation of supernumerary robotic fingers 
along with their customized control interfaces that can be used in augmenting and compensating the 
manipulation abilities of human. The guiding principles of the robotic devices design are safety, wearability, 
ergonomics and user comfort. Throughout, the thesis the other synonyms used for supernumerary robotic 
finger(s) are extra robotic finger(s) or sixth finger. 

The first part of the thesis investigates how to enhance the capabilities of the human hand by means of 
wearable robotic fingers. Adding wearable robotic fingers could give humans the possibility to manipulate 
objects in a more efficient way, enhancing our hand grasping dexterity and ability. In this regard, we design 
and developed a family of extra fingers ranging from fully actuated to underactauated. Together with the 
design issues related to portability and wearability of the devices, another critical aspect is integrating the 
motion of the extra fingers with the human hand. We proposed three possible control strategies along with 
their suitable robotic devices in terms of actuation and sensing capabilities. The first control strategy is 
based on mapping algorithm able to transfer to the extra-fingers a part or the whole motion of the human 
hand. The second one is based on wearable sensorimotor haptic interfaces which enable the user to control 
not only the motion of robotic fingers but also perceive the information related to robotic finger status 
in terms of contact/no contact with the grasped object and in terms of force exerted by the device. The 
third one is electromyographic (EMG) control interfaces to control motion and joints compliance of a 
supernumerary robotic finger. 

The second part of the thesis which is also its major part explores the real potential of supernumerary 
robotic fingers as new gerneration of wearable assistive technology for stroke patients. Stroke and 
amputation are the two main causes of disabilities of the upper limb. While the scientific community 
made remarkable advancements in robotic prostheses for upper-limb amputees [3], only few results are 
available to compensate for missing manipulation abilities in subjects with paretic upper limbs, such as 
subjects suffering from chronic stroke or other pathologies. According to the World Health Organization 
stroke is the disease which leads to most of deaths and high disability problems. Approximately 60% of 
stroke survivors suffer from some form loss of sensory and/or motor function of the hand hand [4]. For 
people with paretic upper limb, most of the attention of the community has been focused on exoskeletons 
[5] which are very difficult to use because of their limitation in accommodating the subjects anatomical 
variations due to impairment. Moreover, the poor wearability, in terms of weight and size, make them 
difficult to use in Activities of Daily Living (ADL). 

One of the biggest challenge of rehabilitation and assistive engineering is to develop technology to 
practice intense movement training at home [6]. The creation of a functional grasp by means of the 
extra-fingers enables patients to execute task-oriented grasp and release exercises and practice intensively 
using repetitive movements. Supernumerary robotic fingers can increase patients’ performances, with 
a focus on objects manipulation, thereby improving their independence in ADL, and simultaneously 
decreasing erroneous compensatory motor strategies for solving everyday tasks. The idea of wearable 
supernumerary limbs as assistive devices is different in nature than other approaches used in rehabilitation 
and assistive robotics. Extra-limbs will provide novel opportunities to recover missing abilities, resulting 
in improvements of patients’ quality of life. 

We also present the combination between the supernumerary robotic finger and the arm support that 
can be used during the rehabilitation phase when the arm is potentially able to recover its functionality, but 
the hand is still not able to perform a grasp due to the lack of an efficient thumb opposition. The overall 
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system also acts as a motivation tool for the patients to perform task-oriented rehabilitation activities e.g. 
box and block, Peg and hole, Frenchay arm test. With the aid of proposed system, the patient can closely 
simulate the desired motion with the non functional arm for rehabilitation. 

Although, mainly the current hope is to use the the supernumerary robotic fingers for compensation but 
we have good expectation in using the device to rehabilitate at least for the arm. Moreover, we also beleive 
that extra-fingers can play a role even in hand rehabiliatin. Patients with hemiparesis often have limited 
functionality in the left or right hand. The standard therapeutic approach requires the patient to attempt 
to make use of the weak hand even though it is not functionally capable, which can result in feelings 
of frustration. The aim is to provide patients with a sense of purpose and accomplishment during ADL 
training, even during the early phase of treatment when the task can only be partially completed. We hope 
that proposed devices can facilitate therapist-guided ADL training and encourage patients to continue 
exercising the affected limb. 

From the neuroscientific point of view, the development of this type of devices opens a series of 
interesting questions on how extra-limbs are perceived by human cognitive system that needs to be 
investigated. 

The next chapters will provide the details of relevant contributions I made in the held of supernumerary 
robotic limbs. In particular, Chapter 1 introduces the supernumerary robotic fingers and state of the 
art. Chapter 2 inverstigates how the extra robotic fingers can augment the abilities of human hand to 
increase its work space and manipulation abilities, we propose the different design guidelines to realize a 
robotic extra-finger for human grasping enhancement. Such guidelines were followed for the realization 
of three prototypes obtained using rapid prototyping techniques, i.e., a 3D printer and an open hardware 
development platform. Both fully actuated and underactuated solutions have been explored. We presented 
mapping algorithm able to transfer to the extra-fingers a part or the whole motion of the human hand. 
Chapter 3 presents how the superumerary robbotic finger can be used to compensate the missing abilities 
on impaired upper limb in chronic stroke patients. The robotic finger and paretic limb act as two parts of a 
gripper to grasp and hold the object. Chapter 4 presents the design, analysis, fabrication, experimental 
characterization and evaluation of two prototypes of soft supernumerary robotic fingers that can be used 
as grasp compensatory devices for hemiparetic upper limb. In Chapter 5, the wearable sensory motor 
interfaces for supernumerary robotic fingers are presenetd. In particular, two kinds of interfaces namely 
’’vibrotactile ring” and hRing are proposed. The human user is able to control the motion of the robotic 
finger through a switch placed on the ring, while being provided with cutaneous feedback about the forces 
exerted by the robotic finger on the environment. In Chapter 6 two kinds of electromyographic (EMG) 
control interfaces for supernumerary robotic fingers are presented. In particular, frontalis muscle cap and 
arm EMG interface. The former is more suitable for underactuated soft fingers while the later is developed 
to control the motion and compliance of fully actuated robotic finger. In frontalis muscle cap the electrodes 
and acquisition boards are embedded in cap which allows the user to control the device motion through 
wireless communication by contracting the frontalis muscle. Chapter 7 presents the combination of soft 
extra finger with the arm support to provide the needed assistance during paretic upper limb rehabilitation 
involving both grasping and arm mobility to solve task-oriented activities. Chapter 8 presents a magnetic 
compatible supernumerary robotic finger for functional magnetic resonance imaging (fMRI) acquisitions 
along with preliminary results on embodiment of supernumerary robotic finger. The thesis concludes 
with Chapter 9 by addressing how the supernumerary robotic fingers are providing novel opportunities to 
recover missing abilities of stroke patients, resulting in improvements of patients’ quality of life. Although, 
until now the supernumerary robotic fingers are mainly being used for grasping compensation but there is 
a good expectation in using these devices to rehabilitation. From the neuroscientific point of view, the 
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development of this type of devices opens a series of interesting questions on how the supernumerary 
limbs are perceived by human cognitive system that are still in process of investigation. 



Introduction 


Chapter 1 


There is nothing comparable to the human 
hand outside nature. We can land men on the 
moon, but, for all our mechanical and 
electronic wizardry, we cannot reproduce an 
artificial fore-finger that can feel as well as 
beckon. 

John Napier 

Over many centuries the human has been extending their physical, cognitive, and social abilities in all 
activities. Every major technological breakthrough in the history made the human more capable, which 
changed the life style and the society. These changes have been many orders of magnitude faster than 
evolutional changes. Robotic applications have rapidly grown from classical industrial applications with 
repetitive tasks to applications with close human-robot interaction. In particular, assistive robotics has 
gained an increasing attention in the last decades, see [7]. 

Among all the robotic solutions, wearable robotics is one of the potential enabling technology to 
improve the humans quality of life. Wearable robotics is increasingly attracting research activity. Wearable 
robots are expected to work very closely, to interact and collaborate with people in an intelligent environ¬ 
ment [8]. Prosthetic devices, exoskeletons and powered suites, wearable sensors and implantable devices 
are just a few examples of the wearable robots that have been developed within the robotics community in 
recent years [9]. Although, two types of wearable robots, prostheses and exoskeletons, have been studied 
extensively, yet numerous technical challenges still exist, particularly for the upper extremities. Moreover, 
these devices are primarily developed for compensating specific disabilities for a certain patient population. 

These are mainly used in substitution of lost limbs or for human limb rehabilitation or to amplify 
strength [5]. In particular, a prosthesis is an artificial device that replaces a missing body part, which may 
be lost through trauma, disease, or congenital conditions as shown in figure 1.1a. Prostheses are beneficial 
in improving the quality of life of amputees, but they are not suitable for hemiplegic and hemiparetic 
patients since the impaired arms and hands are still physically attached to their body. An exoskeleton is a 
wearable robot with joints and links corresponding to those of the human body [9] (see, 1.1b). Exoskeletons 
are robotic external structures, used to amplify strength and endurance, giving the ability to perform else 
impossible tasks (e.g. carrying heavy loads while working on a hard terrain), or to help rehabilitation 
of people who lost some motion functionalities. However, the technological development is reaching a 
turning point where the wearers of the devices can exceed the performance of average people. There are 
already cases where a handicapped athlete can run faster and a longer distance with specific augmentation 
devices. The technology is ready to be extended from compensation to augmentation and enhancement. 

Apart from traditional prosthesis and exoskeletons, a very challenging research direction is to add 
robotic limbs to human, rather than substituting or enhancing them (see, figure 1.1c). This addition could 
let the human augment their abilities and could give support in everyday tasks. In [12], the authors 
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(a) Hand Prosthesis [10] 


(b) Hand Exoskeleton [11] (c) Supernumerary robotic finger [2] 


Figure 1.1: Examples of hand prosthesis, exoskeleton and supernumerary robotic finger are shown: prostheses are 
used in substitution of lost limbs while exoskeleton are suitable for human limb rehabilitation or to amplify strength. 
The supernumerary robotic fingers are addition to human limbs to supplement and augment their abilities without 
substituting them. 


presented the Supernumerary Robotic Limbs (SRL), a wearable robot designed to assist human with 
additional arms attached to the wearer’s body. Such devices, further investigated in [13] and [14] can 
closely cooperate with the human, holding an object, lifting a weight, positioning a work piece, etc.. 
However, finding a trade-off between wearability, efficiency and usability of those bulky extra-arms 
represents still a challenge. In our opinion, the integration with the human body should be of primary 
importance in developing wearable devices. For that reason, we decide to investigate how to augment the 
capabilities of the human hand, instead of developing additional arms. 

To the best of my knowledge, the two main independent contributions on the development of extra 
fingers are from a group at MIT and University of Siena (in the form of this thesis). The main difference 
is that they focused on human hand augmentation to increase the workspace of the healthy hand [15] 
while this thesis investigated not only augmenting healthy hand [16] but even more on subjects with 
impairments to recover manipulation abilities [2]. The MIT group presented in [15], the design of two 
supernumerary robotic fingers to augment the abilities of human healthy hand. Supernumerary robotic 
fingers are mounted on the human wrist to form a 7-fingered hand. 5 human fingers and 2 robotic fingers 
as shown in figure 1.2a. A method for controlling extra robotic fingers in coordination with human fingers 
to grasp diverse objects has been further developed in [17]. The authors presented a control algorithm, 
named Bio-Artificial Synergies, enabling a human hand augmented with two robotic fingers, to share the 
task load together and adapt to diverse task conditions. Postural synergies were found for a seven-fingered 
hand comprised of two robotic fingers and five human fingers through the analysis of measured data from 
grasping experiments. However, this approach in the evaluation of synergies for a hybrid human-robot 
system can be applied only a posteriori, once the system is given, and its application in the synthesis and 
optimization of robotic devices is not trivial. Although two independent extra fingers showed potentialities 
in augmenting human hand functions in healthy subjects but size and proposed control strategies limit 
their possible application as assistive device. 

Differently from their approach, this thesis explored the potential of the supernumerary robotic 
fingers not only in enhancing the human healthy hand manipulation abilities but more than that, in 
recovering the abilities of impaired upper limb in case of stroke patients. To this aim, I developed a 
family of supernumerary fingers ranging from fully actuated to underactuated and soft with their suitable 
sensoribmotor interfaces. Firstly, we investigated the potentials of extra-finger in healthy subjects. Such 
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(a) Faye Wu et al. [15] (b) I.Hussain et al. [16] (c) I.Hussain et al. [2] 


Figure 1.2: Supernumerary robotic fingers developed by MIT and University of Siena to augment and compensate the 
manipulation abilities of human hand. 


devices could give humans the possibility to manipulate objects in a more efficient way, enhancing our 
hand grasping dexterity/ability. An example of a device devloped with in this thesis for augmenting 
human hand is shown in figure 1.2b while more details are presented in chapter 2. Different than the other 
approaches, we focused on modularity, wearability and portability. To further improve, the wearability the 
extra robotic finger can be shaped into bracelet when being not used. 

The first prototype (shown in figure 1.2b) has been presented in [18] together with several examples 
of the extra-finger applications. Apart from the design issues related to portability and wearability of the 
devices, another critical aspect was integrating the motion of the extra-fingers with that of the human 
hand. In [16], we presented a mapping algorithm able to transfer to the extra-fingers a part or the whole 
motion of the human hand. A commercial dataglove was used to measure the hand configuration during 
a grasping task. Although this control approach guarantees a reliable tracking of the human hand, there 
was two main drawbacks to be solved. First, the user lacked a feedback of the robotic finger status and 
could only perceive the force exerted by the device mediated by the grasped object. The second problem 
was related to the approaching phase of the grasp. In fact, the algorithm presented in [16], considers the 
motion of the whole hand to compute the motion of the extra finger, thus limiting the possibility of the 
user to make fine adjustments to adapt the finger shape to that of the grasped object. 

In [19] we addressed these issues by introducing sensorimotor interfaces that can be worn as a ring. 
The human user receives information through the sensorimotor interfaces about the robotic finger status 
in terms of contact/no contact with the grasped object and in terms of force exerted by the device. For 
fully actuated robotic finger, during the grasp approaching phase, we introduced a new control strategy 
that enables the finger to autonomously adapt to the shape of the grasped object. The more details 
on sensorimotor interfaces are presented in chapter 5. The experience gained with healthy subjects 
was fundamental for the development of the devices for recovering the manipulation abilities of stroke 
patients. The devices designed for clinical applications must meet specific human factors related to patient 
conditions and performance criteria. The general guidelines which can be found in the literature include 
safety, durability, energy efficiency, low-encumbrance, ease of use, error tolerance and configurability. The 
specific performance criteria and human ergonomics strongly depends on the actual patient conditions 
and needs. Several experiments with the patients conducted in cooperation with a rehabilitation team 
led us to outline the main functional requirements and human factors which are considered in the design 
and development of devices proposed in this thesis. More details on the ergonomics and functional 
requirements and how these are met during the design and development of the proposed devices are 
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explained in Chapter 4. One of the underactuated soft robotic fingers designed for recovering the grasping 
abilities of stroke patient is shown in figure 1.2c. Note that, in case of soft fingers, the shape adaptability 
is achieved through the intrinsic compliance of the flexible material and underactuation. The use of soft 
supernumerary robotic fingers with stroke patients unfolded and explored their true potential as a new 
generation of wearable assistive devices which is better justified in the remaining part of this chapter. 

Stroke is one of the leading cause to a long term impairment. On average, every 40 seconds, someone 
in the United States has a stroke [20]. Impairment of the hand grasping function is one of the common 
deficits after a stroke: approximately 60% of the stroke survivors suffer from some form of sensorimotor 
impairment associated with their hand [21]. Different motor impairments can affect the hand both at 
motor execution and motor planning/learning level. Deficits in motor execution include weakness of 
wrist/finger extensors, increased wrist/finger flexors tone and spasticity, co-contraction, impaired finger 
independence, poor coordination between grip and load forces, inefficient scaling of grip force and peak 
aperture, and delayed preparation, initiation, and termination of object grip [22, 23]. 

Recovering hand functions is of primary importance during the rehabilitation phase. Many wearable 
devices have been proposed in the last decade, especially for hand rehabilitation and function recover. A 
review on robot-assisted approaches to motor neurorehabilitation can be found in [24] . However, most of 
the devices are designed to increase the functional recovery in the first months of the rehabilitation therapy, 
when biological restoring and reorganization of the central nervous system can take place. However, only 
5% to 20% of patients show a complete recover of upper limb six months after the stroke [25]. When 
in the paretic upper limb the motor deficit is stabilized, the rehabilitation consists mainly in ergotherapy, 
which aims primarily in teaching compensatory strategies that often take advantage of dedicated aids. 
These strategies may sometimes be neither ergonomic nor ecological, or may even increase pathological 
motor patterns, usually by worsening tonic flexion at the forearm of the paretic limb [26]. Existing 
compensatory robotic devices like prostheses, cannot be used for this purpose since the hand of the patient, 
although frequently with limited mobility, is still present. Early results on the replacement of impaired 
hand with robotic devices are reported in [27]. However, this potential solution could be much less 
effective in chronic stroke patients where the whole arm often present a limited residual mobility. Rigid 
exoskeletons do not accommodate variations in patient skeletal structure or joint misalignment and can 
produce compression forces on the soft tissue and joints during long-term use [28]. Moreover, most of the 
proposed exoskeletons result to be quite cumbersome limiting the wearability and portability of the device. 
Besides exoskeletons and prosthesis and their working principles, it is interesting to study other robotic 
solutions which can compensate the missing grasping function. 

The major part of this thesis focuses on how supernumerary robotic fingers can be used by stroke 
patients to improve, recover their missing abilities and can support them in several Activities of Daily 
Living (ADL) specially in bi-manual tasks. 

The majority of daily chores can be classified as “hold-and-manipulate”. They generally require two 
separate actions: maintaining an object in position and altering some characteristics of the object (e.g. 
opening ajar). Due to the added advantage of opposable motion, two hands are usually needed to perform 
such tasks. Those with only one functional hand can modify their behavior and conduct the manipulation 
with the remaining healthy limb; however, an additional tool is often needed to help secure the object 
as it is being manipulated. The main target of the dedicated tools is to let typical bimanual tasks be 
executed using only the unaffected hand, increasing the functional disparity between the two upper limbs. 
Moreover, these tools can be difficult to be carried outside structured environments, so limiting their use to 
rehabilitation facilities or to patient’s house. 

A possible solution is the use of supernumerary robotic fingers. The aim is to come up with a robotic 
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device that can work together with the paretic upper limb instead of replacing it and without causing any 
unnatural forces. In robotics, one of the simplest structure that allows to grasp is the gripper. Industrial 
grippers usually have two fingers and only one degree of freedom. Further simplifying, one finger can 
be seen as a fixed palm and the other one as an active finger able to restrain the motion of an object. If 
we consider the paretic upper limb of the patient as a potential fixed palm, what it is really missed is an 
active finger able to perform the grasp as shown in figure 1.2c. This approach recover the ability to grasp 
and stabilize objects, while keep motivating the patients to use residual mobility of their paretic upper 
limb. The wearable robotic device can easily be carried by patients even outdoors. Finally, a single robotic 
device can replace many commercially available tools to perform ADL, since these tools are generally 
designed to perform a single task. In this view, robotic extra fingers can represent the minimal complexity 
solution that also guarantee extreme wearability and that do not require to be coupled with human impaired 
limbs in order to compensate for missing capabilities. 

The supernumerary finger can be used together with the paretic hand/arm, to constrain the motion 
of the object. The device can be worn on the user’s forearm by means of an elastic band. The systems 
acts like a two-finger gripper, where one finger is represented by the robotic finger, while the other by the 
patient’s paretic limb as shown in figure 1.1c. The preliminary results with patients are presented in [29]. 
The patient can regulate the finger flexion/extension through a wearable switch embedded in a ring worn 
on the healthy hand. Two possible predefined motions can be chosen to obtain either a precision or a 
power grasp. In addition to the switch, the proposed ring interface also embeds a vibrotactile motor able 
to provide the patient with information about the force exerted by the device. Although, the ring based 
control approach resulted simple and intuitive. However, involving the healthy hand in the control of the 
extra-finger can interfere when performing bimanual tasks or when grasping an object, since the patient 
has to be careful not to activate the switch unintentionally. 

In [30] we introduced an EMG interface using frontalis muscles to control the finger flexion/extension 
motion while maintaining the principle of simplicity of the switch. This approach leaves the patient 
free to use his or her healthy hand. Moreover, the frontalis muscle is always spared in case of a motor 
stroke either of the left or of the right hemisphere due to its bilateral cortical representation. The user 
can contract this muscle by moving the eyebrows upwards. The design of earlier presented robotic finger 
was fullyactuated and realized through the rigid structure. The resulting size and weight affect the device 
portability, wearability and robustness. For this reason, we designed and developed soft underactuated 
cable driven robotic fingers to guarantee high wearability and portability. In [2], we presented the Soft- 
SixthFinger which is passively compliant thanks to its flexible joints. Only one motor is used to regulate 
the device flexion through a tendon-driven actuation. The advantage of this solution with respect to the 
previous versions of the device are threefold. The compliance in the structure simplifies the control of the 
device that can passively adapt to the shape of the grasped object [31]. Flexible joints increase also the 
robustness against undesired contacts with the environment [32]. Finally, the tendon-driven underactuation 
reduces the total weight of the device increasing its portability and wearability. To further improve the 
wearability and portability, the device can be worn as a bracelet when it is not used. The patient can 
switch from the bracelet to the operative position by using his or her healthy hand. Moreover, in the 
previous versions of the device, the batteries and all the electronic boards for the control were worn in 
the paretic arm by means of an elastic band. The arising weight limited the mobility on the patient’s 
paretic arm. In the Soft-SixthFinger, the battery bank and the electronics board were moved from the 
paretic arm to a box that can be fixed in the user belt. The result is a sensible reduction of the weight the 
user has to support with the paretic arm. The soft robotic fingers are the results of experimental sessions 
with chronic stroke patients and consultations with clinical experts. More details on the design, analysis, 
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fabrication, experimental characterization and evaluation are illustrated in chapter 4. In a recent work, 
presented in Chapter 7, the combination of the soft supernumerary robotic finger with the zero gravity arm 
support, the SaeboMAS(Saebo, Charlotte, USA) is proposed. The proposed system can be used during the 
rehabilitation phase when the arm is potentially able to recover its functionality, but the hand is still not 
able to perform a grasp due to the lack of an efficient thumb opposition. The overall system also act as a 
motivation tool for the patients to perform task-oriented rehabilitation activities. The patient can closely 
simulate the desired motion with the non-functional arm for rehabilitation purposes, while having a grasp 
compensation with the help of the supernumerary robotic finger. 

Another important question that we are investigating is the neural embodiment of supernumerary 
robotic fingers i.e. how the human brain potentially perceives them. The neural embodiment represents a 
hierarchically higher level interaction of human with the robotic fingers. It considers whether the extra 
robotic devices could enter into the individuals body schema. The first evidence that the perceptual illusion 
of owning an artificial hand could be induced, was provided by the rubber hand illusion in 1998 [33]. 
In 2011, Guterstam [34] demonstrated the possibility of inducing the perceptual illusion of having a 
supernumerary right hand. Their findings suggest that the neural embodiment of a supernumerary limb is 
possible if it is aligned with the body in an anatomically similar fashion as the real limbs. In addition, it has 
been demonstrated that the size of the incorporated body part is not important and ownership illusion can be 
induced towards very small or large bodies [35]. Other studies show that although multiple supernumerary 
limbs can be incorporated into the bodily image (i.e. the sense of ownership towards the supernumerary 
limb), only one can be included in the body schema (i.e. the ability to control the supernumerary limb) 
[36, 37]. 

Previous fMRI studies showed that the human Broca’s area plays a fundamental role in processing not 
only language, but even tool use. This suggests that language and tool use share computational principles 
for processing complex hierarchical structures common to these two abilities [38]. Developing a suitable 
strategy for controlling an extra limb, whether it is a finger or an arm, is of high interest for various fields: 
for example, in [39] authors studied how a surgeon can use his foot to control an extra arm, at least in a 
virtual environment. 

Since it is important that the operator keeps focused on the task he has to perform, the control paradigm 
of the robot should be felt natural to him, as if the supernumerary limb was part of his body. This is why 
the study of embodiment is a fundamental pillar of the research of supernumerary robotic limbs. 



Chapter 2 

Enhancing human hand manipulation abilities through 
supernumerary robotic fingers 


I see technology as being an extension of the 
human body. 

David Cronenberg 

One of the new targets of wearable robots is not to enhance the lift strength far above human capability 
by wearing a bulky robot, but to support human capability within its range by wearing lightweight and 
compact robots. A new approach regarding robotic extra-fingers is presented in this chapter. In particular, 
different design guidelines to realize robotic extra-fingers for human grasping enhancement are proposed. 
Such guidelines were followed for the realization of three prototypes obtained using rapid prototyping 
techniques, i.e., a 3D printer and an open hardware development platform. Both fully actuated and 
underactuated solutions have been explored. In the proposed wearable design, the robotic extra-finger can 
be worn as a bracelet in its rest position. The availability of a supplementary finger in the human hand 
allows to enlarge its workspace, improving grasping and manipulation capabilities. To control the motion 
of extra fingers, an object-based mapping algorithm is proposed by interpreting the whole or a part of the 
hand motion in grasping and manipulation tasks. 

This Chapter is an extended and revised version of the work published in [18, 16, 40]. 


2.1 Introduction 

Wearable robots are expected to work closely, to interact and collaborate with people in an unstructured 
environment [8]. By definition, a wearable robot is a mechatronic system designed around the shape and 
function of the human body, with segments and joints corresponding to those of the person it is externally 
coupled with [9]. Such definition was coined for exoskeletons, whose main purposes were enhancing 
human body force and precision capabilities [41] or helping in rehabilitation processes [42]. The progress 
in miniaturization and efficiency of the mechanical and sensing components has extended the field of 
wearable robotics to new devices which can be seen as extra limbs. In [14] for instance, two additional 
robotic arms worn through a backpack-like harness are presented. However, finding a trade-off between 
wearabilty, efficiency and usability of those bulky extra-arms represents still an issue. 

We started to investigate how to enhance the capability of the human hand by means of wearable robots 
[43]. The goal was to integrate the human hand with additional robotic fingers as represented in Fig. 2.1 for 
the case of a sixth finger. Adding wearable robotic fingers could give humans the possibility to manipulate 
objects in a more efficient way, enhancing our hand grasping dexterity/ability. We designed and developed 
both fully actuated and underactuated solutions for the robotic extra finger. The corresponding prototypes 
can be realized by using standard rapid prototyping techniques (see Fig. 2. 2). Both the solutions share the 
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Figure 2.1: The concept of supernumerary robotic finger: the extra robotic finger is fixed on the wrist opposite to hand 
palm. 

idea of wearability. The devices can be worn as bracelet when they are not activated, and can pop up when 
needed. 



(a) (b) 


Figure 2.2: Fully actuated and underactuated robotic extra fingers prototype. The extra fingers interacts and coordinate 
with the human fingers in grasping and manipulation tasks 

Together with the design issues related to portability and wearability of the devices, another critical 
aspect is integrating the motion of the extra-fingers with the human hand. In fact, demonstration-based 
algorithms as that presented in [14] fail in generality and adaptability to new tasks, while classical 
techniques for exoskeleton controllers, based on the reading of some bio-signal like EMG, limit the 
wearability [44]. 

This chapter also presents a mapping algorithm able to transfer to the extra-fingers a part or the whole 
motion of the human hand. The algorithm extends the method proposed in [45] to the case of a human 
hand augmented with robotic extra-fingers. The mapping algorithm is based on the definition of a set 
of reference points on the so called augmented hand which includes the human hand and the robotic 
extra-fingers. A virtual sphere is defined as a function of the reference points. When the human hand 
fingers are moved, the virtual sphere is moved and deformed. The robotic extra-fingers are then actuated so 
that the reference points on them follow the virtual sphere transformation. The mapping algorithm can be 
applied considering the whole human hand in the definition and in the transformation of the virtual sphere, 
but it is possible to adopt only a part of it, for example three fingers. In this case the remaining fingers, not 
involved in the mapping process, can be used to perform another task. As an illustrative example, let us 
consider the task of holding and opening a bottle. This task can be difficultly performed with only one 
hand. If a robotic extra finger is available, it can be used together with the middle, ring and little finger 
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to hold the bottle, while the index and the thumb can unscrew the cap. As a case study, we developed a 
modular finger that can be worn on the wrist with the help a rubber band. The structure of the modules 
is obtained using rapid prototyping techniques, while the active degrees of freedom (DoFs) are realized 
with servomotors. The main aim of the prototype described in this work is to make human hand more 
symmetric, so that when the human fingers close (when phalanges flex), the extra-finger reflects exactly 
this motion. This extension is going to increase the human hand workspace and its grasping abilities at the 
same time. 

The rest of the chapter is organized as it follows. Section 4.3 illustrates the control framework for 
a robotic extra-finger. Section 2.3 shows the numerical simulations for performance evaluation of the 
proposed control algorithm. In Section 2.4 the design guidelines for robotic extra-fingers are detailed. 
Section 2.4 describes the fully actuated finger, while in Section 2.4 the underactuated version of the finger 
is shown. Finally in Section 2.5 experiments with the prototype of the extra-fingers are presented and in 
Section 2.6 conclusion is outlined. 



(a) The fingertips of the aug¬ 
mented hand are selected as ref¬ 
erence points. The virtual sphere 
is defined as the minimum volume 
sphere containing all the reference 
points, t = to. 


(b) The motion of the human hand (c) The extra-finger is moved ac- 
displaces the reference points and cording to the rigid body motion 
thus deforms and moves the virtual and the deformation of the virtual 
sphere. The reference angle for the sphere, t = to + St. 
joints of the extra-fingers are com¬ 
puted, t = to. 


Figure 2.3: The mapping algorithm. 


2.2 The task-based mapping algorithm 

In this section we describe the general procedure proposed to control the joints of the extra-fingers. The 
algorithm can be extended to an arbitrary number of extra-fingers.We define two different applications 
of the mapping algorithm that can be used in grasping and in manipulation tasks. In particular, the 
whole-hand mapping algorithm considers all the human hand fingers to compute the motion of the robotic 
devices. This algorithm is particularity suitable for grasping task especially in the approaching phase. The 
other application is the partial-hand mapping algorithm which considers only some of the human fingers 
to compute the motion of the robotic fingers. This last approach is useful in manipulation task when a part 
of the hand collaborate with the robotic device to hold an object, while the remaining fingers perform a 
different operation, e.g. unscrew a cap while holding a bottle. 
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The whole-hand mapping algorithm 

Let us define a reference frame So on the hand. Its origin, O is in the wrist center of rotation, the z axis is 
perpendicular to hand palm plane, the x axis is the intersection between the sagittal and the transverse 
plane, pointing towards the little finger, the y axis is consequently defined [46]. Let us indicate with 
Pi G 5ft 3 , i = 1,..., rih the coordinates of reference points on the reference human hand, expressed w.r.t. 
So. In this paper we choose as reference points the five fingertips of the human hand, therefore = 5. 
Note that, the mapping algorithm proposed in [45] does not constraint the choice of the reference point 
positions. However, the fingertips are a preferable selection since they are at the end of the kinematic 
chains represented by the fingers and, thus, their positions contain information about all the joint values. 

Let us assume that all the p\ can be measured or evaluated, for instance by means of an instrumented 
glove and direct kinematic computation. 

Let define as the augmented hand the system composed by the hand with its five fingers and those 
artificial. On all the robotic fingers, a reference point is placed at the tip. The augmented hand is then 
characterized by a set of reference points that is the union of the set of reference points on the human 
fingers and the set of points on the artificial ones. The reference points for the augmented hand are then 
Pi G 5ft 3 , i = 1, • • • , n a , with n a > n^. The first nh reference points are the same of the human hand, 
i.e. p 1 ^ = Mi < rih while the remaining n a — rih points are those relative to the extra-fingers. Let 
us indicate with O the minimum volume bounding sphere containing all the n a reference points of the 
augmented hand. Let o h indicate its center and let r h be its radius. Let us define a reference frame Si on 
the virtual sphere, whose origin is in the sphere center and whose axis are, in the reference starting position, 
parallel to So axis. The reference starting position is arbitrary and do not affect the mapping procedure as 
detailed in [45]. Assume the augmented hand in its starting position at time instant t = to. Assume also 
that at time instant t = t o + St the reference point coordinates p\ change due to the motion of the human 
hand. Let us indicate with A p\ G 5ft 3 , i = 1, • ■ • , rih a vector containing such coordinate variations. 
This displacement produces a transformation in the virtual sphere, that in this paper we approximate as 
the combination of a rigid body motion and an isotropic deformation. The rigid body motion can be 
furthermore represented as the combination of a translation A o h G 5ft 3 and a rotation A<f> G 5ft 3 . The 
rotation term A<f> G 5ft 3 is defined as 


= [A(f>, Ad, Aipf , 


where A'lp represents the rotation w.r.t. x axis, AO represents the rotation w.r.t. y and A i/j represents the 
rotation w.r.t. z axis. It is worth to recall that, even though the rotations between reference frames are not 
commutative, and the rotation order is therefore important, if the rotation angles are small , the rotation 
order is not significant. The non rigid isotropic deformation can be described by the parameter As G 5ft 
defined as 



r 

With these assumptions, we can express the displacement of each reference point on the human hand as 
follows 


Apf = Ao h + A$ x (pf - o) + As (pf - o) . 


( 2 . 1 ) 


In this paper we do not consider other types of transformations for the sake of simplicity, however the 
method can be integrated to include a non-isotropic transformation, as described in [47], and also shear 
deformations [48]. Eq. (2.1) can be applied to all the reference points p\, leading to the following linear 
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system 

A p h = (2.2) 

where A p h = [ApJ' T , • • • , ApJ( 3 ] T e R 3 '"' is a vector collecting all the reference point displacements, 
= [Ao T , A<h T , A s] T is a 7 x 1 vector containing the unknown parameters describing the sphere 
transformation, including the translation term A o h , the rotation term A 4/ and isotropic deformation term 
As, finally, A E 5ft 3n ^ x7 is the linear system matrix, defined as 


A = 


in which each submatrix Aj E 5ft 3 x 7 is defined as 


At 

A nu 


Ai = 


I —s(Pi — o ) (p^ — o ) 


The linear system in eq. (2.2) can be solved, to find 

A£ = A + Ap h + Na'iP 


(2.3) 


where A + denotes a generic pseudo-inverse of A matrix, while Na E 5ft 7 x/l represents a basis of A 
matrix nullspace, whose dimension is h > 0, and ijj is an arbitrary /^-dimensional vector parametrizing 
the homogeneous solution of the system. When h > 0, the vector ip can be defined to optimize a cost 
function that can be defined on the basis of the task, e.g. when a grasping task is performed, we would 
need to assure grasp stability, maximizing As magnitude, while in object manipulation tasks, in which 
the contact forces should be constant, we should maximize A o and A4> and minimize As. Once the 
sphere transformation parameters have been evaluated we need to generate the command signals for the 
extra-finger joints. What we impose is that also the reference points of the extra-fingers move according 
to the transformation parameters computed on the virtual sphere. In particular, we consider that for all p? 
with rih < i < n a , 

Ap“ = A o h + A4> x (p? - o) + As (pf - o) , (2.4) 

where the parameter Ao, A<f> and As are those computed in eq. (2.3). The joints of the robotic fingers 
are then controlled to obtain on the fingertips the displacement evaluated in eq. (2.4). Let n q indicate the 
number of joints of the artificial fingers and let J a E |ft 3 ( n a -n ^) xn <? indicate the finger Jacobian matrix, 
we can evaluate finger joint displacements as 

A q a = J+Ap“ + Njx, (2.5) 


where J+ denotes a generic pseudoinverse of robotic finger Jacobian matrix, Nj E 5R n « xn x is a matrix 
whose columns form a basis of J a , n x represents the dimension of robotic finger redundancy space, 
n x > 0, and x G J£ nx is a n x -dimensional parameter parametrizing the homogeneous part of the solution, 

! For any three-dimensional vector v = [vi, V 2 , ^ 3 ] T , s(v) indicates the skew matrix associated with vector v, i.e. 


s(v) 


0 — V3 V2 

V 3 0 —V\ 

—V2 V\ 0 
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which represents the redundant motions of the robotics fingers. Due to the computational time and the 
dynamics of the robotic fingers, the joint displacements A q a computed at the time sample t = to is 
effectively executed at time t = to + St, where St indicates the sampling time. This delay does not affect 
the mapping procedure. The mapping algorithm is pictorially represented in Fig. 2.3. Once the robotic 
finger has been actuated, at the time t = to + St the virtual sphere is re-calculated and the procedure is 
repeated. 


The partial-hand mapping algorithms 

The human hand can perform complex tasks that involve both grasping and manipulation. As an example, 
let us consider the task of open a bottle. Depending on the size of the bottle and on user ability, either the 
task can be performed using only one hand (the bottle is held by the middle, ring and little fingers and the 
hand palm, while the thumb and the index are in charge of opening it), or the task cannot be performed 
using only one hand, since the three fingers and the palm are not sufficient to guarantee grasp closure 
properties [49]. The extra-finger could be used in this example to let the hand hold the bottle, while the 
thumb and the index unscrew the cap. In such scenario, it would be useful to relate the motion of the 
robotic fingers only to some of the hand fingers, for instance the middle, ring and pinkie fingers. This 
solution leaves the thumb and the index able to act independently and does not affect grasp tightness. 

Framing in the procedure previously described, we have = 3 and n a = 4. It is still possible to 
define a sphere passing through the reference points, and A matrix dimensions are 9 x 7, so the linear 
system defined in eq. (2.2) can be solved to obtain the transformation parameters Ao, A4> and As, that can 
be used to control the motion of the robotic finger. From the theoretical point of view, it is then possible to 
control the robotic extra-finger mapping only three of the five human fingers. 

More complex manipulation tasks could require the use of three fingers, namely the thumb, index 
and middle, leaving the remaining two and the robotic one to hold the object, This yields = 2 and 
n a = 3. The definition of the sphere containing the three points is a priori not determined (to define 
a sphere, four points are necessary). However, among the infinite spheres that can be defined, we can 
choose that with minimum radius, whose center is in the geometric center of mass of the points and whose 
radius is the distance between the reference points and the center. The resulting A matrix has dimensions 
6x7 and, thus, the linear system in eq. (2.2) admits infinite solutions. We could reformulate the problem 
approximating the transformation that the human fingers apply to the virtual sphere with a rigid body 
motion, neglecting the deformation. In this case, the reference point displacements are related to the sphere 
transformation parameters by 

Ap!? = Ao + A<f> x (pf - o), 

for i = 1,2, that can be rewritten as 

A p = A rb A£ rb , 

in which A p h = [Apf, Ap^P, irb = [Ao, A4>] T and 


I -s(p% - o) 
I -s(p% - o ) 


€ 5R 6x6 . 


Matrix A is invertible, unless the reference points are coincident, and then we can estimate the sphere 
transformation parameters as 


U = A- 1 Ap h . 
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Such parameter are used to project the sphere transformation onto the robotic extra-fingers, as previously 
detailed. It is worth to observe that A^ matrix corresponds to the transpose of the classical Grasp matrix, 
[50]. We furthermore observe that, if the augmented hand is grasping an object with two human and a 
robotic fingers, we impose to the robotic finger to follow the human ones without changing the internal 
contact forces. 


2.3 Numerical simulation 

The performance of the proposed control algorithm has been evaluated through a series of numerical 
simulations using SynGrasp , a Matlab Toolbox that aims at simulating and analyze hand grasping. The 
toolbox includes functions to define the hand kinematic structure and the contact points with a grasped 
object. New functions have been added to describe a hand model where also extra-fingers are considered. 
Concerning the human hand, in this work we consider the 20 DoFs hand kinematic model detailed in 
[51,52]. 

The structure of the human hand has been augmented with the robotic extra-finger prototype model, 
which has 4 DoFs: one for the finger abduction/abduction motion and three simulating the phalanges’ 
flexion/extension motion. The resulting augmented hand structure has then 24 DoFs. To control the 
robotic extra-finger, the mapping algorithm previously illustrated has been implemented. The numerical 
simulations were devoted to evaluate the role of the robotic extra-finger in grasping tasks. We considered 
the grasping of simple shape objects, namely spheres, cubes, and cylindrical pipes, with different sizes, 
varying from 40 mm to 140 mm the radius/edge. We analyzed and compared three configurations: (1) the 
human hand, (2) the complete augmented hand, (3) the augmented hand in which the robotic finger is 
controlled with only three fingers of the human hand, namely the middle, ring and pinkie fingers. 

For each grasp, we analyzed the values of one of the grasp quality indexes, in this case the grasp 
isotropy index ( GII ) discussed in [53], defined as the ratio between the minimum (Jmin.G and maximum 
°max,G singular value of the grasp matrix G, 

qjj _ ®min,G 

&max,G 

The index GII measures the contribution of the contact forces to the total wrench exerted on the object, 
and varies from 0 to 1. Its optimal value, i.e. i = 1, corresponds to an isotropic grasp, in which the 
magnitudes of the internal contact forces are similar. Further details on the definition and evaluation of 
grasp matrix G are available in [50]. 

The results, in terms of grasp quality matrix, are summarized in Figure 2.4, showing the GII index as a 
function of the object size, for different grasping conditions and different objects. The robotic extra-finger 
improves the grasp quality index, in particular for large size objects. These results confirm the intuitive 
observation that an additional robotic thumb improves grasp capabilities of the human hand enlarging 
its workspace. We furthermore observe that activating the robotic finger using the data from only three 
fingers of the human hand we obtain grasps with a slightly lower quality measure GII w.r.t. the complete 
augmented hand, however such values are generally higher than those obtained with the human hand, 
especially for larger objects. Fig. 2.5 shows some examples of grasps realized with the human and the 
augmented hand. 
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Figure 2.4: Grasp isotropy index, i.e. ratio between the minimum and maximum singular value of grasp matrix G , 
obtained for different object shapes and sizes, with the human, the augmented hand, and the augmented hand with 
n h — 3. 


2.4 Design guidelines for robotic extra-fingers 

Wearability is the common target of the design guidelines for robotic extra fingers. In the solutions 
proposed in this paper, the finger can be easily worn by the user by means of an elastic band. It wraps up 
on the wrist as a bracelet when it is not used and it pops-up when it is actuated, as shown in Fig. 2.7. A 
push button is used to switch between the two positions in the presented prototypes. The extra-fingers 
should be able to mimic the motion of human hand’s fingers so in both the designs the kinematics of 
human fingers are partially resembled. Joints in the finger are connected to partially resemble the human 
finger mechanical structure. Our fully actuated finger design is based on this principle while ensuring the 
structure design to have reasonable size, workspace and use of 3D printed material for rapid prototyping 
and light in weight. Hand fingers, excluding the thumb, consists of four phalanxes connected by three joints 
[54, 55]. The structure of the thumb is different, since it has two joints at the base for the anterposition or 
retroposition combined with the radial or palmar abduction motions. 

The other fingers are capable of both adduction-abduction and flexion-extension motions. The proximal 
and distal interphalangeal articulations can have only flexion/extension motion capabilities and typically 
are represented with a single DoF revolute joint. The metacarpal joints have both adduction/abduction 
and flexion/extension motion capabilities and can be modeled as a 2 DoFs joint composed of two revolute 
joints with orthogonal rotation axis (universal joint). We choose this kinematic structure to design the 
robotic extra finger. In the fully actuated version of the device one motor is adopted to actuate each DoF of 
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(g) (h) (i) 


Figure 2.5: Example of grasps evaluated during the numerical simulations. First row: grasping with the human hand; 
second row: grasping with the augmented hand; third row: grasping with the augmented hand in which the index and 
the thumb are not active. First column: grasping a sphere; second column: grasping a cube; third column: grasping a 
cylindrical pipe. 

the robotic-finger, so two motors at the base realize the adduction/abduction and flexion/extension motions, 
while one motor for each interphalangeal joint is necessary. The finger’s kinematic model is typically 
approximated by using simple revolute joints. This approximation is an effective means of modeling, as 
these are in fact the same as compared to proximal and distal joints of humans. Although for metacarpal 
joints simple revolute joint approximation is not valid, adduction/abduction motion are approximated by 
adding an additional actuator. 

In the rest of the section we will describe in details the two proposed kinematic structures. 
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(a) Exploded and normal of unit mod- (b) CAD model of complete (c) CAD model for the device 
ule finger for opposite to four opposite to thumb 

fingers 


Figure 2.6: CAD Design of unit module and complete fully actuated fingers for both positions are shown. The single 
DoF modules are connected through a wrist rubber band to wear the device. 


Fully Actuated Finger 

The fully actuated finger has a modular structure. The final size of the device and the number of DoFs 
can be selected according to dimension of the user’s hand. Modularity also offers robustness considering 
that robot parts are interchangeable. Each unit module consists of a servo motor and two plastic parts. 
It results in one DoF and its dimensions are 42 x 33 x 16mm. The same modules can be connected 
through screws to obtain more complex kinematic chains like the modular hands described in [56]. The 
cad design of unit module and complete fingers are shown in figure 2.6. The position of the extra-finger 
on the wrist is crucial to obtain the desired performance in different applications. At the moment, we 
have considered two possible positions on the wrist that we called central and second thumb , as shown 
in Figure 2.7. In the central configuration, the finger is placed in the center of the wrist, opposite to 
the four fingers of human hand so to enlarge the hand workspace. The finger is a four DoFs modular 
structure. Three DoFs are obtained considering three modules in a pitch-pitch connection, which is used to 
replicate the flexion/extension motion of the fingers. These modules are connected through a base servo 
motor to a rubber band that allows to wear the device on the wrist. The base servo motor reproduces the 
abduction/adduction capability of the fingers. 

In the second thumb configuration, the aim is to provide an additional thumb to the hand, placed next 
to the pinkie finger. 

The CAD models and the prototypes realized for both the positions are shown in Fig. 2.6 and Fig. 2.7. 
Table 2.1 shows the D-H parameters of the modular device. All the electronics is enclosed in a 3D printed 
box attached to the finger to make it wearable. 

Underactuated Compliant Finger 

For the underactuated finger, we developed only the second thumb version, since it resulted to be the more 
suitable to fit the user wrist. Due to its passively compliant structure, the finger can adapt to the shape of 
the grasped objects [57]. Underactuated fingers in compliant grippers generally use elastic elements in the 
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(a) Central configuration. 


(b) Second thumb configuration. (c) The extra-finger rest position. 


Figure 2.7: The robotic extra finger in two possible configurations on the wrist. 
Table 2.1 : Denavit-Hartenberg parameters for the extra-finger, where a — 42 mm. 
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not actuated joints, which are then compliant and passively driven [58]. The concept of underactuation in 
robotic fingers is different from the one that is usually presented in robotic system. In an underactuated 
finger, the actuation torque r a is typically transmitted to the phalanges through suitable mechanical design, 
e.g., four-bar linkages, pulleys, tendons and gears etc. Since underactuated fingers have more DoFs than 
actuators, passive elements are used to constrain the finger and to ensure the shape adaptation of the finger 
to the grasped object [59]. The proposed underactuated robotic finger has two motors. One motor is used 
for the flexion/extension of the whole finger. The other motor accounts for adduction/abduction motion 
and it is also used to switch between rest and operative position. The finger has four phalanges and a 
base part. All the phalanges are connected by screws. Bearings are used to reduce the friction between 
phalanges. Also in this case we have pursued modularity and wearability concepts in designing a device 
that can be worn as a bracelet in its rest position. The base part of the finger consists of a motor, a switch, 
electronic circuitry and a wrist band. The finger’s drive mechanism is a nylon wire, which connects the 
outermost phalanges with the motor through a pulley. If no torque is applied, the finger is completely 
straight. When the motor is activated the wire is pulled and the finger bends to grab the object. The springs 
placed on the back of the finger are used to bring it to its original position when required. 

In order to derive the kinematics equation of the under-actuated finger, we have assumed the planar 
motion of the finger, i.e. abduction/adduction is not considered. We can estimate the position of the finger 
in the relative plane with the help of forward kinematics, provided that the link lengths and joint angles are 
known. According to the dimensions and geometric properties of the realized prototype, the total spring 
stiffness for the four springs is 3.5016 N/cm. The total deflection required to bend the finger completely is 
1.4 cm and thus corresponding force is F m 4.9 N. The pulley on which the wire is rolled has a radius of 
0.7 cm. Thus the motor torque required to fully flex the finger is 0.35 kg-cm. The motor used is HS-55 
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(a) Assembled (normal) view 
of the complete finger. 

Figure 2.8: CAD models and prototype of the underactuated finger. Passive unit modules can be added/removed to 
adjust the length of finger. 

micro lite servo which has operating torque of 1.1 to 1.3 kg cm. The CAD and real prototype of the 
underactuated compliant finger are reported in Fig. 2.8. 

2.5 Experiments 

We performed several experiments to test the capability of the developed fingers to enlarge hand workspace 
in grasping tasks and increase human hand dexterity We focused mainly into two different tasks that we 
called: anatomically impossible grasps and ulnar grasps. In the former case, we tried to grasp objects 
which cannot be grasped using only one hand. In the latter, we tried to grasp objects only using the ring 
and the pinkie fingers opposite to the sixth finger. In this case the upper part of the hand (thumb, index and 
medium fingers) is left free to do another task allowing, for instance, to hold multiple object in one hand, 
to unscrew a bottle cap with a single hand, etc. 

In Fig. 8.3-a and 8.3-b, the fully and the under actuated fingers are performing ulnar grasps. In both 
cases the thumb, index and medium fingers grasp one object, while ring, pinkie and sixth finger, the other. 
In Fig. 8.3-c and 8. 3-d the extra finger is used to perform anatomically impossible grasps. In particular, in 
Fig. 8.3-c the second thumb configuration is used, while in Fig. 8. 3-d the central. The last two pictures in 
Fig. 8.3 shows two possible applications of the sixth finger. In Fig. 8.3-e the user can unscrew a cap from a 
bottle using only one hand. Ulnar grasp is used to keep firm the bottle, while the other fingers can unscrew 
the cap. Finally, in Fig. 8.3-f the fully actuated finger in the central configuration is used to open a door. 
The user is holding an heavy bag so cannot open the door with the same hand. He/she uses the extra finger 
to turn the handle, while keeping the bag with the hand. 

In all the experiments, the joint reference angles of the extra-finger are related to the human hand 
posture. To track the human hand, we used the Cyberglove III System [60]. 



(b) Prototype of the underactu¬ 
ated robotic finger. 
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(a) Grasping multiple objects in 
one hand: fully actuated finger in 
second thumb configuration. 


(b) Grasping multiple objects in 
one hand: underactuated finger. 


(c) Grasping box: fully actuated 
finger in second thumb configura¬ 
tion. 



(d) Grasping box: fully actuated 
finger in second thumb configura¬ 
tion. 


(e) Opening bottle with one hand: 
underactuated tiger. 


(f) Opening the door, while keep¬ 
ing a bag: fully actuated finger in 
central configuration. 


Figure 2.9: Different tasks performed with the aid of robotic-extra fingers.. 


2.6 Conclusion 

In this chapter, we presented a mapping algorithm to control robotic devices that can be used as extra¬ 
fingers. The control signals are computed without requiring explicit commands by the human user, but 
interpreting human hand motion. The number of tracked fingers in the human hand can be selected 
according to the task to be fulfilled so to leave some fingers free to move without interfering with the 
devices’ behavior. The chapter also presented the design guidelines and prototype development of robotic- 
extra fingers for human hand enhancement. A fully and an under actuated fingers are designed and their 
prototypes are realized by using 3D printer and open source arduino platform. The fingers are customized 
for different positions on the wrist and can be worn by a rubber band. This solution allows to enlarge the 
hand workspace, increasing the grasp capability of the user. The control signals are computed without 
requiring explicit commands by the human user, but interpreting human hand motion. We provided several 
experiments to prove the usability of the extra fingers. The underactuated finger resulted to be more light 
and portable than the other. The passive compliance of the finger allowed to adapt more easily to the shape 
of the grasped object. On the other side, the fully actuated version resulted to be more precise in following 
the high level control inputs and more powerful in terms of grasp tightness. 

We believe that these simple and cost effective devices could have a great impact in understanding the 
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effectiveness of robotic extra-fingers in augmenting human hand through wearable robotics. 



Chapter 3 

Compensating hand function in chronic stroke patients 
through the supernumerary robotic finger 


The human condition today is better than it’s 
ever been, and technology is one of the reasons 
for that. 

Thomas Leo Clancy 

A novel solution to compensate hand grasping abilities is proposed for chronic stroke patients. The 
goal is to provide the patients with a wearable supernumerary robotic finger that can be worn on the paretic 
forearm by means of an elastic band. The proposed prototype is a modular articulated device that can 
adapt its structure to the grasped object shape. The extra-finger and the paretic hand act like the two parts 
of a gripper cooperatively holding an object. We evaluated the feasibility of the approach with four chronic 
stroke patients performing a qualitative test, the Frenchay Arm Test. In this proof of concept study, the 
use of the supernumerary robotic finger has increased the total score of the patients of 2 points in a 5 
points scale. The subjects were able to perform the two grasping tasks included in the test that were not 
possible without the robotic extra-finger. Adding a robotic opposing finger is a very promising approach 
that can significantly improve the functional compensation of the chronic stroke patient during everyday 
life activities. This Chapter is an extended and revised version of the work published in [30, 29, 61] 


3.1 Introduction 

Stroke is a leading cause of long-term disabilities, which are often associated with persistent impairment of 
an upper limb [20]. Findings of available prospective cohort studies indicate that only 5% to 20% of stroke 
patients with a paretic upper limb manage to fully recover six months after the stroke [25]. However, 33% 
to 66% show no recovery of upper limb functions after the same period [62, 63]. A key role in functional 
recovery of stroke patients with a paretic upper limb seems to be played by the improvements of the 
paretic hand [64, 65]. The recovery of hand functionality also contributes to a better independence in the 
Activity of Daily Living (ADL). In this respect, the rehabilitation projects, by which the rehabilitation 
team customized to the patient typologies and intensity of interventions, have been recently integrated with 
robotic-aided therapies. Such treatments represent a novel and promising approach in rehabilitation of the 
post-stroke paretic upper limb. Several robotic devices have been developed to provide safe and intensive 
rehabilitation to patients with mild to severe motor impairments after neurologic injury [66, 67]. The 
use of robotic devices in rehabilitation can provide high-intensity, repetitive, task-specific and interactive 
treatment of the impaired upper limb and can serve as an objective and reliable means of monitoring 
patient progress [68, 69, 70]. Focusing on the hand therapy, Lum et al. reviewed in [24] several works on 
robot-assisted approaches to motor neurorehabilitation highlighting the prototypes used in clinical tests. 
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Robotic Sixth Finger 

Figure 3.1: The supernumerary robotic finger concept. An additional robotic finger is worn by the patient on the 
forearm and is used in grasping tasks. 


In [71], the authors presented a comprehensive review of hand exoskeleton technologies for rehabilitation 
and assistive engineering, from basic hand biomechanics to actuator technologies. However, the majority 
of these devices are poorly wearable, and designed to increase the functional recovery in the first months 
after stroke, when, in some cases, biological restoring and plastic reorganization of the central nervous 
system take place. To the best of our knowledge, few devices have been designed to actively compensate 
hand grasping function when patients are in a chronic state. In fact, when in the paretic upper limb the 
motor deficit is stabilized, the rehabilitation consists mainly in ergotherapy, which aims primarily in 
teaching compensatory strategies by using the non-paretic upper limb and by using commercial special 
aids [72]. This potentially increases the functional disparity between the impaired and the unaffected upper 
limb [73, 26]. 

This work focuses on the compensation of hand function in chronic stroke patients. Our idea is to aug¬ 
ment the functional abilities of the patient with an additional robotic finger prosthesis, the supernumerary 
robotic finger, that is worn on the wrist/forearm of the patient, as in Fig. 3.1. Such robotic finger is used 
together with the paretic hand/arm to constrain the motion of the object to be grasped. The system acts 
like a two-finger gripper, where one finger is represented by the supernumerary robotic finger while the 
other by the patient paretic limb. The final aim of the supernumerary robotic finger is to increase upper 
limb functionality and subsequent independence in ADL in stroke survivors in relation with their personal 
demands and lifestyle, when no more functional motor improvements seem to be achievable. The area of 
impact may be identified by the “International Classification of Functioning, Disability and Health (ICF)” 
[74], domain “fine hand use (d 440)”, “performance” in “Activity and Participation” component. 

The design of the proposed compensatory tool has been driven by robotic and rehabilitation teams, 
starting from patients requirements in improving upper limb functionality, when the motor deficit is 
unchangeable. This need is particularly felt by young and social-active patients, for achieving better 
independence, and for continuing rehabilitation in a compensatory perspective. A preliminary version 
of the device together with preliminary usability tests with healthy subjects have been presented in [18]. 
In [16], we have introduced an object-based mapping algorithm to control the motion of the extra robotic 
finger. The main feature of the mapping was to create a synergy between the human hand posture and 
the robotic extra-limb configuration. Such approach required to track the human hand motion to generate 
suitable trajectories for the device. Thus, it could not be exploited in post-stroke patients due to the very 
limited residual mobility of the hand. One of the challenging questions for the supernumerary robotic 
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Table 3.1: The supernumerary robotic finger technical details 


Module dimension 

42 x 33 x 20 mm 

EMG board dimension 

67 x 55 x 31 mm 

Support base dimension 

78 x 24 x 5 mm 

Module weight 

8g 

EMG board weight 

98 g 

Support base weight 

18 g 

Max torque per motor 

0.15 Nm 

Stall current 

440 mA 

Velocity of one module 

0.2 rad/s 

EMG Board power supplies 

5 V, 3.3 V 

Device external batteries 

7.5 V, 2.2 Ah 

Continuous operating time 

3.5 h (@stall torque) 

Max device payload 

610 g 


finger as tool for stroke patients is how to control its motion. 

In this work, we propose a novel approach for the user interface which is explicitly designed for post¬ 
stroke patients. The user can control the finger flexion/extension through an electromyographic (EMG) 
signal captured by surface electrodes placed on the user’s frontalis muscle. We have also redesigned the 
device to be used with this controller. With respect to the device presented in [18], we have added two 
new features: autonomous adaptation to the object shape and detection of patient request to tight the grasp 
during a manipulation task. Such dexterity is obtained through the active control of the stiffness at the 
joints level. The extra-finger is compliant while making the grasp with the object and becomes stiffer 
when more grasp force is required by the user. The admittance control implemented will be presented in 
Section 3.2. 

To test the usability of the proposed prosthesis for grasp compensation, we set up a pilot experiment 
involving four subjects in a chronic state. The subjects worn the supernumerary robotic finger and 
were asked to perform the tasks comprised in the Frenchay Arm Test [75]. This test included different 
manipulation tasks that patients were not able to perform, but were successfully accomplished with the aid 
of the robotic extra-finger. 

The rest of the paper is organized as follows. In Section 3.2 the supernumerary robotic finger prototype 
together with the adopted control strategies are described in details. Section 8.4 presents the qualitative test 
performed and the achieved results. Finally, Section 3.4 reports a discussion on the usability and limitation 
of the proposed device, while in Section 3.5 conclusion and future work are outlined. 
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Figure 3.2: The supernumerary robotic finger. On the left the CAD exploded view, while on the right the prototype 
used in the experiments. 


3.2 The supernumerary robotic finger 

Device structure and low-level control 

The supernumerary robotic finger is composed by four one-DoF modules. Each module consists of a 
servomotor (HS-53 Microservo, HiTech, Republic of Korea), a 3D printed plastic part (acrylonitrile 
butadiene styrene, ABSPlus, Stratasys, USA) and a soft rubber part used to increase the friction at the 
contact area. Modules are equipped with a Force Sensing Resistor (FSR) (408, Interlink Electronics Inc., 
USA) placed under the rubber part and able to measure the normal component of the force applied on the 
module surface. The modules are connected so that one extremity of each module is rigidly coupled with 
the shaft of the motor through screws, while the other has a pin joint acting as revolute joint. The CAD 
exploded view of the modular finger and the real prototype are shown in Fig. 3.2. Technical details of the 
device are reported in Table 8.2. 

The module connection results in a pitch-pitch configuration, which replicates the flexion/extension 
motion of the human finger. In [18] also abduction/adduction motion was obtained by means of a dedicated 
module placed on the finger base. In this work this possibility will not be considered. The modular part 
of the finger is connected to a support base which contains also the electronic housing. An elastic band 
allows to easily wear the device on the forearm. An external battery is used to provide power to all the 
circuits. All the electronics is enclosed in a 3D printed box attached to the support base to preserve the 
extra-finger wearability. The module actuators are PWM controlled servomotors. The PWM signals are 
generated by an Arduino Nano board [76]. 

The motion of the supernumerary robotic finger is controlled by the user through the EMG interface, 
as it will be described in Section 3.2. Two possible flexion trajectories can be selected in order to grasp 
objects with different sizes and shapes. The two possible arising grasps have been defined as precision and 
power grasp, see Fig 3.3. In precision grasps, the target is to hold the object between the paretic limb and 
the device fingertip pad. To this aim, the fingertip is kept parallel to the paretic limb during flexion motion. 
In power grasps, each module flexes with a fixed step size in order to wrap the finger around the object. 
The patient selects with the EMG interface the type of grasp according to the object size or the task to be 
executed. When the grasping phase is started, the extra-finger flexes according to the type of grasp selected. 
We consider the completely extended finger as the starting position to enlarge the set of possible graspable 
objects. The finger closing velocity is a priori set by using Arduino servo library. We set the velocity to 
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0.2 rad/s to let the patient reorient the device during flexion, if needed. The force sensors on the modules 
are used to detect contacts with the grasped object. We simplify the non-linear relation between the voltage 
variation on the sensors and the equivalent applied force considering a piecewise-linear function. Vernier 
dynamometer (Vernier, USA) was used to calibrate and verify the output of the sensors. A module is in 
contact with the object when the force measured with the FSR reaches a predefined threshold. 

In precision grasps, the contact is expected to occur between the object and the fingertip module. In 
power grasps, in order to obtain suitable contact points, we set different closing priorities according to the 
position of the module in the finger. If the fingertip module comes in contact first, the remaining modules 
stop. If another module comes in contact first, modules below to it stop, while the module above keeps 
moving. 

When the grasping phase is complete, it is necessary to control the force exerted by the device on the 
object to guarantee the stability of the grasp. The forces contributing to the grasp stability are the result of 
the action of the paretic limb together with the action of the supernumerary robotic finger. We designed a 
controller that is able to regulate the force exerted by the extra-finger according to that required by the user. 
When the patient wishes to tight the grasp, he or she pushes the object toward the device with his or her 
hand/wrist. This action results in a force variation measured by the FSR placed in each module and in a 
displacement of the servomotors from the position reached at the end of the grasping phase. We introduce 
a parameter kd to regulate the position error of the servomotor proportional to force observed by FSR. We 
set a linear relation between the force variation measured by the FSR placed in each module and the value 
of kd . In particular, the range of forces read by the force sensors (0.6 N - 6 N) was linearly mapped in the 
range 0.3 — 3 of parameter kd . Then, the possible angle displacement A q is computed as 

Aq = kdijldes Qm ): 

where g m is the actual position of the servomotor while qd es is its desired position. We modified the 
servomotor in order to measure its actual position by accessing the internal encoder measurements. The 
only servomotor parameter that can be set is its desired position qd es • At time instant t the desired position 
for the i —th servomotor is computed as 

qdes,i^) = Qm,i(t - 1) + A qi(t ~ 1). 

In presence of a rigid grasped object, the measured positions of the extra-finger joints do not change due to 
the object constraints. So that, changing the desired position of the servomotors we can control the force 
exerted by the device onto the object. 

The resulting behavior is similar to an admittance control of the motor. Generally, in admittance control 
framework, the compliant (or stiff) behavior of the joints is achieved by virtue of the control, differently 
from what happen in mechanical systems with a prevalent dynamics of elastic type [77]. Varying the 
parameter kd the module appear to be more or less stiff with respect to an external applied force. 

We set priorities between modules for the simulated compliance variation, similarly to what we did for 
the grasping procedure. So that, if, for instance, only the fingertip module is in contact with the object, 
all the other modules change their stiffness accordingly. This solution allows to control the stiffness of 
modules that are not in contact with the object. 

When the patient wants to release the grasped object, he or she needs to lower the force exerted by his 
or her hand/wrist on the object so to decrease the value of kd . Eventually, using the EMG interface, the 
robotic finger can be placed back to its home position by following a predefined trajectory. 

Note that if the patient is not able to exert force on the object, due to his or her motor deficit or to the 
position of the supernumerary robotic finger on the forearm, the grasp tightness can be controlled through 
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Figure 3.3: The two grasp modalities of the robotic extra-finger. On the left, a precision grasp is obtained between the 
fingertip of the device and the radial aspect of the thenar eminence. On the right, a power grasp is obtained between 
the whole device and the user wrist. 



Figure 3.4: On the left, the EMG board used. On the right the EMG electrodes placed on the patient head. 


the EMG interface. The patient can activate the finger flexion, wait for finger shaping and then activate 
again the flexion to tight the grasp. This solution requires a higher cognitive effort from the patient that 
has to estimate which is the sufficient grasp force necessary to hold the object. When possible, admittance 
control is preferable also in order to optimize battery consumption. 

EMG user interface 

The interface with the user must be designed so to appear intuitive and simple. As a preliminary solution, 
the patient could activate the robotic extra-finger flexion/extension through a switch represented by a 
push button embedded on a ring worn on the healthy hand [19, 29]. Although this solution dramatically 
simplified the interaction with the device, wearing a ring on the contralateral hand and operating the switch 
could prevent the healthy hand from doing other tasks. For example, when performing bimanual tasks or 
when grasping an object, the subject had to be careful not to activate the switch unintentionally. For this 
reason, we have developed an EMG interface which maintains the principle of simplicity of the switch, but 
that leaves the patient free to use his or her healthy hand. 
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Table 3.2: Commands detected through the EMG interface 


EMG signal 

Associated action 

one contraction 

move/stop 

two contractions 

change direction 

three contractions 

change grasp mode 


Thanks to the proposed EMG interface, patients can consciously control the supernumerary robotic 
finger by contracting the frontalis muscle on their forehead. Bipolar EMG electrodes are positioned on 
the frontalis muscle, since its functionality, due to a bilateral cortical representation, is always spared in 
case of a hemispherical stroke. Activation of the muscle is achieved by moving the eyebrows upward. 
Functionality of muscles of the paretic limb is usually sub-optimal, hence scarcely reliable for EMG control. 
Moreover, using the paretic limb for a dual task (i.e., EMG control and grasping) can be too demanding for 
most of patients. In the proposed system, patients worn a headband where surface electrodes are placed, 
see the right side of Fig. 5.2a. The electrical activity measured by the electrodes (one ground and two 
recording electrodes for true differential recordings) is acquired through an embedded system (Muscle 
SpikerShield, Backyard Brains, Ann Arbor, MI - USA) that can be worn on the patient’s arm thanks to 
an elastic band, see the left side of Fig. 5.2a. This EMG interface system for bio-signals acquisition is 
designed to be used with dry electrodes and no skin preparation. The board includes a gain knob to tune 
the amplification of the muscle recording depending on the size and type of muscle. This feature has been 
used to filter involuntary muscle contractions. The EMG interface board consists of a signal conditioning 
board and an Arduino Uno that processes the signals. Dimensions and weight of the board are reported in 
Table 8.2. We have designed the processing unit in order to obtain a trigger signal if the recorded EMG 
signals exceed a pre-set threshold. 

The EMG interface is thus able to detect if the frontalis muscle of the patient is voluntary contracted. 
Upon this, we have implemented a high level control strategy that is summarized in Table 3.2. With one 
muscle contraction the patient controls the motion/stop of the finger. When the finger is stopped, two 
contractions in a time window of 1.5 s switch the motion direction from flexion to extension and viceversa. 
Finally, when the finger is in its starting position (completely open), the user can change the finger flexion 
trajectory (power or precision grasp) making three contraction in a time window of 2 s. 

Device positioning in the patient paretic limb 

The position of Robotic Sixth Finger on the patient forearm is an important aspect to take into account. 
Before deciding where to wear the device, it is necessary to study both the residual mobility of the patient 
and the ADL we want to accomplish. The Robotic Sixth Finger can be placed in the distal part of the 
forearm (near, or on the wrist) since the grasp is obtained by opposing the device to the paretic hand. 
However, the distal positioning of the supernumerary robotic finger may fail when the post-stroke motor 
deficit is so advanced that a pathological synergism in flexion has taken place. In this case, the wrist 
becomes too much flexed and fingers are too much closed towards the palm thus not allowing a successful 
grasping. When this pathological condition occurs, the supernumerary robotic finger may be positioned 
more proximal at the forearm, in a way that the grasp can be achieved by the extra-finger opposition to the 
radial aspect of the thenar eminence or to the anatomical snuff box. An example of two possible positions 
for the supernumerary robotic finger are reported in Fig. 3.5. 
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(a) (b) 


Figure 3.5: The robotic extra finger in two possible configurations on the forearm, (a) The grasp is obtained at the 
wrist level, (b) The grasp is obtained at the hand level. 

This flexibility in the positioning is achieved thanks to the modularity of the structure and the flexibility 
of fixing support. Modularity allows to regulate the size and dexterity of the finger according to the 
position on the forearm and according to the limb characteristic of each patient. The regulation is obtained 
adding/removing modules on/from the device. The support base of the finger can be translated or rotated 
along the arm to place the finger on a suitable position and orientation. An elastic band and rubber spacers 
are used to increase the grip and comfort, while reducing the fatigue during continuous use of the finger. 


3.3 Pilot experiment 

In the current proof of concept study, we tested with four subjects (three male, one female, age 48 — 60) 
how the supernumerary robotic finger can compensate for grasping capability. The aim was to verify the 
potential of the approach and to understand how rapidly the subjects can successfully interact with the 
wearable device. In this direction, we performed a fully ecological qualitative test, the Frenchay Arm 
Test [75] as shown in Fig. 3.6. The test consisted of five pass/fail tasks to be executed in less then three 
minutes. The patient scored 1 for each of the successfully completed task, while he or she scored 0 in case 
of fail. The subject sat at a table with his hands in his lap, and each task started from this position. He or 
she is then asked to use the affected arm/hand to: 

1. TaskJ Stabilize a ruler, while drawing a line with a pencil held in the other hand. To pass, the ruler 
must be held firmly (see Fig. 3.6a). 

2. TaskJ Grasp a cylinder (12 mm diameter, 50 mm long), set on its side approximately 150 mm from 
the table edge, lift it about 300 mm and replace without dropping (see Fig. 3.6b). 

3. TaskJ Pick up a glass, half full of water positioned about 150 to 300 mm from the edge of the table, 
drink some water and replace without spilling 1 (see Fig. 3.6c). 

4. Task.4 Remove and replace a sprung clothes peg from a 10 mm diameter dowel, 150 mm long set 
in a 100 mm base, 150 to 300 mm from table edge. Not to drop peg or knock dowel over (see 
Fig. 3.6d). 

! Note that for safety reasons we did not use water in presence of electronic components. 
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5. Task-5 Comb hair (or imitate); must comb across top, down the back and down each side of head 
(see Fig. 3.6e). 

When compared with other upper limb assessments, the Frenchay arm test has shown good reliability in 
measuring functional changes in stroke patients [75]. The score ranges from 0 (no one item performed) to 5 
(all the items performed). All the subjects taking part to the experiment have been affected by stroke more 
than two years before the test. The rehabilitation team has declared that no more functional improvements 
are achievable with respect to the gained upper limb motor performance. The supernumerary robotic 
finger can be used by subjects showing a residual mobility of the arm. For being included in the pilot 
experiment, patients had to score < 2 when their motor function was tested with the National Institute of 
Health Stroke Scale (NIHSS) [78], item 5 “paretic arm”. Moreover, the patients showed the following 
characteristics: 1) normal consciousness (NIHSS, itemla, lb, lc = 0), absence of conjugate eyes deviation 
(NIHSS, item 2 = 0), absence of complete hemianopia (NIHSS, item 3 < 1), absence of ataxia (NIHSS, 
item 7 = 0), absence of completely sensory loss (NIHSS, item 8 < 1), absence of aphasia (NIHSS, item 
9 = 0), absence of profound extinction and inattention (NIHSS, item 11 < 1). Patients received the 
supernumerary robotic finger in the paretic hand, the left hand for two subjects and the right one for the 
other two. Thanks to the device design, the same prototype can be worn either on the right or on the left 
arm. Written informed consent was obtained from all participants. The procedures were in accordance 
with the Declaration of Helsinki. 

The rehabilitation team assisted the subjects during a training phase that lasted about one hour. During 
this phase, the optimal position of the device on the arm according to the patient motor deficit was evaluated. 
The patients also tried the EMG interface in order to become confident with the extra-finger high-level 
control. Two patients tried the extra-finger for the first time. After the training, the subjects had three 
minutes to perform the Frenchay Arm Test. All the subjects performed the test twice, one with and one 
without the device. We randomly decided the starting condition. The supernumerary robotic finger was 
placed on the paretic limb, while it was activated using the EMG interface. In Fig. 3.6a, 3.6b, 3.6c, 3.6d 
and 3.6e snapshots of the execution of the five tasks are reported, respectively. The results of the test are 
shown in Table 7.2 for the four patients. All the subjects selected a precision grasp for the cylinder, while 
a power grasp was used for the glass. 

Task 2 and Task 3 were successfully accomplished by all the patients with the help of the extra-finger. 
Task 4 and Task 5 involved the grasp of an object and a rather complex manipulation part. Although the 
patient were able both to grasp the sprung and the comb, the poor residual mobility of the arm caused a 
failure in the task fulfillment. Task 1 was executed both with and without the device. This means that the 
device did not interfere with the residual mobility of the paretic limb thank to its high wearability and 
portability. 

After the Frenchay Arm Test, the patients were asked to fill a questionnaire in order to evaluate the 
subjective feelings on the ease of use of the device. Results are reported in Table 3.4. Moreover, the two 
patients that already tried a previous version of the device with a switch-ring interface declared to prefer 
the new EMG interface. 


3.4 Discussion 

The exploitation of the supernumerary robotic finger in post-stroke compensation of hand functions is at 
an early stage. The device has been built upon the ideas of wearability, ergonomics, safety, ease of use 
and comfort, while increasing the upper limb functionality of post stroke patients. Most of the devices 
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(a) Task 1: stabilize a ruler, 
while drawing a line with a 
pencil held in the other hand. 
Note that the supernumerary 
robotic finger does not inter¬ 
fere with the task execution. 


(b) Task 2: grasp a cylin¬ 
der (12 mm diameter, 50 mm 
long). A precision grasp is 
used to grasp the small cylin¬ 
der. 


(c) Task 3: pick up a glass and (d) Task 4: remove and re¬ 
drink. A power grasp strategy place a sprung clothes peg 
is used to achieve the grasp, from a dowel. 



(e) Task 4: remove and re¬ 
place a sprung clothes peg 
from a dowel. 


Figure 3.6: The Frenchay Arm Test 

Table 3.3: Results of the Frenchay Arm Test (FAT) for the four patients with and without using the supernumerary 
robotic finger 


Task 

Pal 

with 

dent 1 

without 

Pal 

with 

dent 2 

without 

Pal 

with 

dent 3 

without 

Pal 

with 

dent 4 

without 

Stabilize a ruler 

1 

1 

1 

1 

1 

1 

1 

1 

Grasp a cylinder 

1 

0 

1 

0 

1 

0 

1 

0 

Pick up a glass 

1 

0 

1 

0 

1 

0 

1 

0 

Remove a sprung 

0 

0 

0 

0 

0 

0 

0 

0 

Comb hair 

0 

0 

0 

0 

0 

0 

0 

0 


designed for hand rehabilitation share the aim of assisting finger motion during an assigned training. Many 
algorithms for human-robot interaction can be programmed also into simple robotic devices. Lum et al. 
have classified in [24] the main features of different control strategies available in literature. Although 
our device is not designed for hand rehabilitation but for compensating hand function in grasping tasks, 
some of the proposed strategies has been taken as guidelines for the design and interface of our devices. In 
particular, we considered: i) adaptation to patient performance; ii) prevention of fatigue and frustration 
and iii) production of more physiologically accurate movement patterns. The adaptation to the patient 
performance is obtained considering the versatility of the device to be worn in different parts along the 
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Table 3.4: Questionnaire and relative marks. The mark ranges from “0 = totally disagree” to “7 = totally agree”. 
Mean and standard deviation (Mean (STD )) are reported. 


Question 

Answer 

The EMG interface results intuitive easy to 

use. 

6.75(0.5) 

I did not need any particular training to start 
using the interface. 

6(0.81) 

I felt confident using the system. 

6.25(0.5) 

I think that I would need the support of 
a technical person to be able to use this 
system every day. 

3.25(1.71) 

The system was easy to use. 

6.25(0.5) 

I would imagine that most people would 
quickly learn how to use this system. 

7(0) 


forearm according to patient capability of oppose to the device motion. Moreover, the control of the 
compliance of the device allows the user to select the tightness of the grasp. To prevent fatigue and 
frustration on the patient, the motion of the supernumerary robotic finger is not mechanically coupled with 
the human limbs. The patients’ muscle are not constrained to follow any particular trajectory imposed by 
the extra-finger. Patients only need to be able to place their forearm in a suitable position, so to let the 
object be in the workspace of the robotic device. 

Finally, in case of traditional exoskeletons, precautions need to be carried out in terms of kinematics 
design and during their use to avoid any abnormal posture that can produce any physiologically inaccurate 
movement patterns. The use of the extra-finger results to be safer in this regard. 

All the patients were able to improve their performance in tasks of everyday activities without the need 
of any specific training period, thus suggesting that the successful use of the supernumerary robotic finger 
is rather intuitive, at least for these very basic activities. This aspect is also confirmed by the answer to 
the questionnaire in Table 3.4. The ease of use represents an important point, taking into consideration 
that a proportion of stroke patients may also complain of some cognitive deficits, possibly limiting their 
compliance during a demanding learning phase. Now, the challenge is to identify and better understand 
the different requirements coming from the different application scenarios. 

The pathological synergism in flexion is characterized by the arm and the forearm intrarotated, adducted 
and flexed at their main joints, as well as fingers closed. Patients may show a deficit not only in grasping 
the object and keeping it, but also in releasing it. This motor pattern is mainly due to two factors: weakness 
of extensors muscles and hypertonia of flexors. The patients that have tried the supernumerary robotic 
finger experienced a new ability in releasing the utilized objects without the aid of the healthy hand, as 
well as the ability to grasp an object without the help of the contralateral limb. 

Compensation process by using extra-finger motivates the patient to use her or his muscles to co¬ 
ordinate with the device for the completion of the task. Thus, the extra-finger acts like an active and 
motivational assistance device. This approach encourages the patients to use their potential and residual 
abilities effectively instead of being fully dependent on the motion of robotic device like passive assistive 
devices [79]. In this view, the use of the supernumerary robotic finger shares conceptual similarities with 
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the constraint-induced movement therapy (CIMT), a rehabilitative approach characterized by the restraint 
of the healthy upper limb accompanied by the shaping and repetitive task-oriented training of more affected 
upper extremity, with the purposes of overcoming the learned nonuse phenomenon of the hemiplegic upper 
extremity [80]. However, the obvious advantage of the supernumerary robotic finger is that there is no 
need to immobilize or restraint the healthy limb to favor the (re)use of the paretic hand. 


3.5 Conclusion and perspectives 

In this chapter we presented a robotic compensatory tool that can be used by chronic stroke patients to 
regain grasping capabilities at the paretic hand. The latter phase of post-stroke rehabilitation is identified 
by the “compensation phase”. In this phase, functional recovery is based on the learning of newly acquired 
motor strategies to compensate the neurological deficit. These strategies may sometimes be neither 
ergonomic nor ecological, or may even increase pathological motor patterns, usually by worsening tonic 
flexion at the forearm of the paretic limb. We expect to increase patients’ performances, with a focus 
on objects manipulation, thereby improving their independence in ADL, and simultaneously decreasing 
erroneous compensatory motor strategies for solving everyday tasks [81]. 

The proposed control of the robotic finger dramatically simplifies the human robot interaction since 
only the activation of a grasping procedure through the EMG interface is needed. 



Chapter 4 

Design and development of soft supernumerary robotic 
fingers for grasp compensation in chronic stroke patients 


I can never satisfy myself until i can make a 
mechanical model of a thing. If I can make 
mechanical model, I can understand it 

Lord Kelvin 

This chapter presents design, analysis, fabrication, experimental characterization and evaluation of 
two prototypes of soft supernumerary robotic fingers that can be used as grasp compensatory devices for 
hemiparetic upper limb. 

In recent years, several researchers have focused on the development of simple, compliant, yet strong, 
robust, and easy-to-program manipulation systems to overcome the common issues of rigid multi-fingered 
robotic hands. Although many prototypes have been proposed, there is still a lack of a systematic way 
for soft hand design. One of the most critical element that plays the role in the succesful grasp and shape 
adaptation of the object is the trajectory of the robotic fingers which can be regulated by acting on their 
joints stiffness. We propose a method to compute the stiffness of flexible joints and its realization in 
order to let the fingers track a certain predefined trajectory. We refer to tendon driven, underactuated 
and passively compliant hands composed of deformable joints and rigid links. The finger joints can be 
given specific stiffness and pre-form shapes such that a single cable actuation can be used. We define 
firstly a procedure to determine suitable joints stiffness and then we propose a possible realization in 
robotics fingers hardware structure. The stiffness computation is obtained leveraging on the the mechanics 
of tendon-driven hands and on compliant systems, while for its implementation beam theory has been 
exploited. We validate the proposed framework both in simulation and with experiments using a prototypes 
of the devices. 

The devices are the results of experimental sessions with chronic stroke patients and consultations 
with clinical experts. Both devices share a common principle of work which consists in opposing to the 
paretic hand/wrist so to restrain the motion of an object. They can be used by chronic stroke patients to 
compensate for grasping in several Activities of Daily Living (ADL) with a particular focus on bimanual 
tasks. The robotic extra fingers are designed to be extremely portable, wearable, robust and capable to 
adapt to different object shapes. They can be wrapped as bracelets when not being used, to further reduce 
the encumbrance. Both devices are intrinsically-compliant and driven by a single actuator through a tendon 
system. 

This Chapter is an extended and revised version of the work published in [2] 
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4.1 Introduction 

Wearability is the key feature of the robotic devices designed for assisting the patients in activity daily 
living, since the devices should be used by the patients also outside the rehab facilities. In [9], Pons et 
al. outlined two possible categories of wearable robots: exoskeletons and prosthetic robots. The former 
are designed to complement the ability of the human limb and restore the handicapped function usually 
mapping onto the anatomy of the human limb. The latter are electro-mechanical devices that substitutes 
for lost limbs after amputation. In this work, we enrich these definitions by introducing a wearable robot 
which is grounded on the human body, but that is not mechanically coupled with the human limb. We do 
not attempt to assist the paretic hand/arm motion of the patient, but rather we add just what is needed to 
grasp: an extra thumb. The robotic extra-finger is worn on the user forearm and can accomplish a given 
task in cooperation with the paretic limb. A preliminary prototype, called the Robotic Sixth Finger, has 
been proposed in [18, 19, 29]. The fully actuated structure allows the Robotic Sixth Finger to actively 
shape around an object, but the resulting size and weight affect the device portability and wearability. 



(a) The soft sixth finger concept. 



(b) The double soft sixth finger concept. 


Figure 4.1: The proposed wearable robotic compensatory devices for hemiparetic upper limb, (a) The soft sixth finger: 
a single extra finger is proposed to compensate for missing hand grasping function (b) The double soft sixth finger: a 
double finger is proposed to increase the grasp stability and the payload. 

In this work, we present two novel prototypes of wearable grasp compensatory devices for hemiparetic 
upper limb: the soft sixth finger and the double soft sixth finger, see Figure 4.1. The devices have been 
designed to guarantee high wearability and portability. The devices can be worn as a bracelet when these 
are not being used. The patient can switch from the bracelet to the operative position by using his their 
healthy hand. Moreover, in the previous versions of the device, the batteries and all the electronic boards 
for the control were worn in the paretic arm by means of an elastic band. The arising weight limited the 
mobility on the patient’s paretic arm. In the Soft-SixthFinger, we moved all the batteries and the electronics 
board from the paretic arm to a box that can be fixed in the user belt. The result is a sensible reduction of 
the weight the user has to support with the paretic arm. 

The double soft sixth finger device has been designed to improve grasp stability in more payload 
demanding tasks. We doubled the flexible structure of the device to obtain two fingers. The two fingers are 
attached to a base that can be worn at the user’s forearm. The device is actuated by a single motor and the 
two fingers design improves the grasp stability and robustness, we presented a systematic way to compute 
the stiffness ratio between the passive compliant joints so to obtain a desired trajectory for the finger. The 
proposed method assumes a given target motion of the fingertip and a given maximum actuation force 
for the tendon driven system to compute the stiffness value of the passive joints. We proposed a modular 
approach to define robotic fingers. The performances of the devices were through an experimental setup. 
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Figure 4.2: Underactuated cable driven flexible finger. The finger has modular structure. Each module is composed of 
soft and stiff parts. 

The results showed major improvements in the performance characteristics of the devices as compared to 
older version of the device, in particular, the improvement in grasp stability, fingertip force and maximum 
payload. 

4.2 The soft sixth finger and the double soft sixth finger 

The wearable assistive robotic devices used for clinical applications must meet specific human factors and 
performance criteria. The general guidelines which can be found in the literature include: durability, energy 
efficiency, low-encumbrance, ease of use, error tolerance and configurability [82]. The specific performance 
criteria and human ergonomics strongly depends on the actual patient conditions and needs [83, 84]. In 
order to improve the wearability and the acceptability of the devices for the users, the design must meet a 
number of conditions related to ergonomics and functionality [85]. Several experiments with the patients 
conducted in cooperation with a rehabilitation team reported in [29, 2, 30] led us to outline the main 
functional requirements and human factors reported in Table 4.2. 


Category 

Requirement 

Literature/Experimental Observa¬ 
tions 

Ergonomics 




Wearability 

To be wearable the device should be of 
low-encumbrance [86]. 


Portability 

To be used also outside the laboratory 
and structured environment in outdoor 
applications [87]. 


Weight 

To minimize the weight at the forearm. 
The arm impairment causes less mo¬ 
bility and capability to lift and carry 
loads [2]. Lightweight (< 400 g) [28]. 


Ease of use 

To provide freedom to patients in wear¬ 
ing and using the device without any 
assistance [83]. 
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Functional 




Robustness 

To resist to unwanted collisions with the 
environment [31]. 


Fatigue avoidance 
and safety 

To avoid un-natural forces on human 
muscles during the use of device which 
can cause fatigue and frustration [9], the 
human-robot safe interaction must be 
ensured [88]. 


Device adaptability to 
patient’s conditions 

The device positioning according to pa¬ 
tient’s conditions and residual mobility 
of the arm/hand [30]. 


Control interface 

adaptability to 

patient’s conditions 

The bio-signal control interface must 
be adaptive to patient dependent nature 
of signal variations and given detection 
conditions [89]. 


Device coupling with 
human arm 

To firmly couple the device with human 
forearm, in order to realize a stable grip 
even in the presence of heavy loads [90] . 


Object shape adapt¬ 
ability 

To adapt to objects with different shapes 
and sizes [91]. 


Stable grasp 

To realize a stable grasp during hold¬ 
ing, lifting and pouring tasks, involving 
objects of various sizes and weights. 


Mechanical power 

To generate the contact forces (5 N) re¬ 
quired for successfully grasping objects 
of daily living [10]. 


Configurability 

To easily adjust according to patient spe¬ 
cific needs, e.g., the desired control in¬ 
terface, the length of the device, easy 
assembly of parts, etc. [83] 


Functional versatility 

To accommodate a wide variety of 
objects and tasks associated with 
ADL [92]. 


Energy efficiency 

To avoid expensive, unsafe and heavy 
energy sources [87] . 


Error tolerance 

To provide robustness to positioning 
and sensing errors, and having mechan¬ 
ical design features suited to grasp sta¬ 
bility including: high friction, natural 
distributed compliance and underactua¬ 
tion [91]. 
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Simple and intuitive 

To realize simple and user friendly con¬ 


interfaces 

trol interface [10]. 


We considered these ergonomics and functional requirements in the design and development of the 
proposed robotic devices. Table 4.5 summarizes how we met these requirements in our devices while the 
detailed design and development methodology are explained in corresponding sections. 

The compensatory devices have been designed to be wearable, robust and capable to adapt to different 
object shapes. In general, the robustness plays a twofold role. First, it enables the robotic devices to reliably 
grasp objects in the presence of large sensory uncertainty. Second, it enables the devices to withstand 
large impact and other forces due to the unintended contact with the environment. The robustness and 
soft interaction are mainly achieved by either regulating the compliance of robotic joints [93] or tuning 
the intrinsic softness, acting on the passive characteristics of the robot body ware [94, 58, 95]. The former 
approach is based on complex and bulky variable impedance actuators aiming to be used in different 
contest. Our devices are inspired by the latter approach in order to be simple, light in weight and compact 
in size. The proposed devices are based on principle of underactuated cable driven flexible and modular 
structure as shown in Figure 4.2. The passive compliance in the joints guarantees the robustness and safety 
during the interaction with the environment. The devices can endure collisions with hard objects and 
even strikes from a hammer without breaking into pieces. In addition to this, the actuation system of the 
proposed devices resembles that of underactuated robotic hands [96] . Underactuated hands have desirable 
adaptability to shapes, and can be effectively implemented using relatively simple differential and elastic 
elements. The transmission solutions allow motion of other joints to continue after contact occurs on a 
coupled link, allowing the hands to passively adapt to the object shape [91]. Passive adaptability allows 
to drive the device with a reduced number of control parameters. The built-in compliant nature of the 
extra-fingers and underactuation increase their ability to grasp different objects. They can adapt their 
shape to that of the grasped object. Shape adaptation increases the grasp performance by compensating 
the uncertainties in sensing, actuation and helps in stabilizing the grasp [97]. The robustness and intrinsic 
compliance is realized through the cable driven flexible structure of the robotic fingers. A mathematical 
model, presented in Section 4.3, has been used to study the kinematics of such cable driven flexible 
finger and to simulate its bending profile. The simulation results helped in minimizing the manufacturing 
iterations, in particular adjusting the stiffness in each joint to obtain a desired finger closing trajectory 
and length of finger to cover a certain workspace. In Section 4.2 the detail design, development and 
performance evaluation of the soft sixth finger are explained. Section 4.3 describes the design, development 
and preliminary evaluation of the double soft sixth finger. Wearability and device position at forearm 
according to patient’s condition are detailed in Section 4.3. 

The Soft Sixth Finger 

The soft sixth finger is composed of two main parts, a flexible finger and a support base as shown in 
Figure 4.3. The flexible finger is built with a modular structure. Each module consist of a rigid 3D printed 
link realized in ABS (Acrylonitrile Butadiene Styrene, ABSPlus, Stratasys, USA) and covered with a 
silicon skin and a 3D printed thermoplastic polyurethane part (Lulzbot, USA) that acts as the flexible joint. 
We selected polyurethane for flexible parts because the high elongation of this material allows for repeated 
movement and impact without wear or cracking proving also an excellent vibration reduction. Reasons 
for adding passive elements are manifold, including storing elastic energy, avoiding tendon slackness, 
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Figure 4.3: The CAD exploded view of unit module, complete soft sixth finger and Dovetail passive locking mechanism. 
Two holes in the module for double tendon, modular structure of the device, support base and actuator are shown. 


passive compliance, the distribution of forces over a large contact area and ensuring the uniqueness of the 
position [98]. The modules are connected by sliding the thermoplastic polyurethane part in the ABS part. 
This method makes the assembling process easy without using any screw or passive elements to combine 
the modules. The length and closing trajectory of the device have been selected according to the procedure 
presented in Section 4.3. 

The device is designed and developed by combining two different manufacturing processes, i.e., 3D 
printing and moulding. The skeleton of the device is fabricated by rapid prototyping 3D printing while the 
silicon skin is realized by moulding process. The moulding process shapes the raw material using a solid 
frame of a particular shape, called a pattern. We used 3D printed skeletons to hold the liquid silicon in 
desired shape until it turned solid. We realized closed-top moulds which are used for more complex part 
geometries. We pored the silicon mixture over the skeletons of the modules and support base and used 
other mold’s parts to constrain the liquid silicon to achieve the desired geometry and shape of the skin. 
Metal tubes were inserted into the module holes so to avoid silicon to fill the tendon holes. In Figure 4.4, 
the top row shows the exploded view of the parts used in the moulding process, the bottom row shows 
the assembled configuration of parts during the curing process of liquid silicon. The silicon used is Fast 
Rubber FR-18 which is bi-component and cures at room temperature. The mixing ratio of components 
are 100 g of resin per 5 g of hardner. It has viscosity of 30 Pa-s and the final hardness is 17±2 shore A. 
The silicon skin on the rigid links is realized through casting process, aiming to increase the friction at the 
possible contact areas. The mold parts used in casting process are shown in Figure 4.4. 

The support base of the device has been designed to assure a firm grip on the arm. The ergonomic 
design of the support base guarantees the stability of the device to withstand the applied load. The support 
base consists of two parts coupled with velcro strips to facilitate wearing the device at the forearm and 
guarantee adaptation to different arm sizes. The upper part contains the actuator and base module of 
the robotic finger. Both parts are covered with a silicon skin to increase the comfort and stability at the 
forearm. The skeleton of the support base is 3D printed by ABS material and silicon skin is realized 
through the moulding process. The support base and the flexible finger are coupled through Dovetail 
triangle locking mechanism, which is described in detail in Section 4.3. This mechanism is used to switch 
between working and rest position of the devices. The structure of the support base is symmetrical, feature 
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Figure 4.4: Moulding process to realize silicon skin. Mold parts, module skeleton and support base skeleton are 3D 
printed. The metal wires are inserted in the tendon wire holes. 

that enables the robotic devices to be worn on both the left or the right arm of the patients without any 
modification in the device. The device actuation is achieved by using a single actuator and two tendons 
running in parallel through the modules of the finger. The holes in the rigid links allow the passage of the 
cables (polyethylene dyneema fiber, Japan) which are used to realize the tendon driven actuation. The 
tendon wires run through the finger and are attached on one side to the fingertip and on the other to a 
pulley rigidly connected to the actuator shaft. When the motor is actuated, the tendon wires are wound on 
the pulley reducing the length of the wire and thus flexing the finger. As the motor is rotated in opposite 
direction, the extension of the finger is achieved thanks to elastic force stored in the flexible parts of the 
modules. The actuator used is the Dynamixel MX-28T (Robotis, South Korea). Principal details on the 
motor features are reported in Table 4.5, while for a complete description, the reader is referred to [99]. We 
use ArbotiX-M Robocontroller [100] to drive the Dynamixel motor. This control solution for Dynamixel 
motors incorporates an AVR microcontroller, a socket for an Xbee wireless radio and the motor driver. 
The technical details are summarized in Table 4.5. 


4.3 Fingertip trajectory definition through joint stiffness design 

In this section we propose a mathematical framework to compute the stiffness of compliant joints necessary 
to track a desired flexion trajectory with the fingertips of a compliant underactuated finger. In particular, 
we firstly define how to compute the stiffness values and then how to realize passive compliant joints with 
a given stiffness once the geometry of the passive joints is defined. 

Problem definition 

Let us assume a hand composed of rtf fingers, with n q joints, actuated by a series of n t tendons. For 
the sake of simplicity we assume that all the joints in the hand are revolute (R), so that the variable qi 
describing i-th displacement is a rotation. Let us indicate with q = [gi, •, q nq ] T £ 3? Uq a vector containing 
hand joint rotations and with t G 5P nt tendon displacements. Let us collect in the vector p G Ji n/nd the 
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vectors p* G 3? nd describing position (and eventually orientation) of a reference frame representing the 
i-th fingertip with respect to a reference frame that we assume as a basis, fixed, for instance, on hand palm. 
We indicate with rid the dimension of the configuration space for the fingertip, for example, rid = 3 in the 
planar case, rid = 6 in the more general three dimensional case. 

From the kinematic analysis of hand fingers, it is possible to relate tendon displacements t to hand 
joint configuration q, i.e., 

t = t(q), (4.1) 

where t(q) : W 1 ' 1 —> 5R n * is the transformation function, that in the more general case is nonlinear and 
depends on system geometric dimensions and tendon routings. Considering a small variation of tendon 
lengths and joint angles with respect to a reference configuration, the above relationship can be linearised 
as 

St = T(q)5q, (4.2) 

where T(q) is the Jacobian of the function introduced in eq. (4.1), that can be evaluated as T(q) = 

In some cases, when the tendons are connected through pulleys with a circular radius, it can be shown 
that eq. (4.1) is linear and then T matrix is constant. In this case T G 5R nt XUq is a transformation matrix 
whose elements depend on finger pulleys’ sizes and tendon routing topology and is independent from hand 
posture [96]. By applying the Principle of Virtual Work to the hand it is possible to obtain the dual static 
relationship 

r = T T f, (4.3) 

where r G is a represents hand joint torques and f G 5R nt is a vector containing tendons’ pulling 
forces. If the hand is not in contact with an object or a surface, and the joints have passive elastic elements, 
the following equation can be used to describe hand dynamics 

B(q)q + n(q, q) = r a + r/( q, q) + r fl (q) + r p (Aq), (4.4) 

where r p (Aq) expresses the torque generated by the deformation of elastic elements, that can be evaluated 
as a function of joint deformation Aq, evaluated w.r.t. a reference (rest) position of the hand qo, i.e., 
Aq = q — qo, T/(q, q) expresses the equivalent joint torques due to frictional effects, t 9 ( q) models 
the gravitational terms, B(q) represents the inertia matrix, and n(q, q) contains centrifugal and Coriolis 
terms. In this model we consider applications in which the velocities are limited, so that we can neglect 
the inertial and viscous terms. Furthermore, we assume that the torque generated by the deformation of 
elastic elements is higher than the one due to gravitational effects. The friction between tendons and finger 
parts could give a not negligible contribution, however its prediction depends on several parameters that 
cannot be easily considered (e.g., surface and material properties) and has not been included in the model 
for the sake of simplicity. With the above simplifications the dynamics of the system can be reduced to 

r a + r p (Aq) = 0 (4.5) 

Also this expression can be linearised if we consider a variation of the loading condition with respect to an 
initial reference configuration, 

St a = K ? (q)<5q. (4.6) 

The linearisation leads to the introduction of the joint stiffness matrix K q G symmetric and 

positive definite, that can be evaluated, at a given configuration q, as 
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In the more general case, stiffness matrix K g depends on joint configuration. 

The problem that we want to solve is: how can we design hand joint stiffness K q so that, when 
applying a certain force profile f r (£) to the tendons, the fingertips of the hand follow a certain trajectory 
p r (£)? Fingertip trajectories could be defined for instance to perform a certain specific task, or according 
to mapping procedures as those described in [45], aimed at reproducing postural synergies identified for 
the human hand on robotic hands with dissimilar kinematic structures. We solved the problem by sampling 
the trajectory in a series of elementary steps and solving for each step the linearised equilibrium equation. 
The first step consists in solving the inverse kinematics for each finger, finding, for each time sample t k 
(k indicates the generic time sample) the joint configuration vector q d(t k ) corresponding to the desired 
fingertip configuration p d{t k )- The variation of hand configuration corresponding to the sample k is given 
by Sc\k = qd(^/c) — qd(£/c-i)- This variation is produced by applying to the tendons a force variation 

Sfk = ^rifk) — fr ifk—l) • 

The following step consists in evaluating the stiffness matrix that allows to replicate such an elementary 
motion. Assuming that the K q matrix is diagonal (i.e., the joints are independent), the problem can be 
solved straightforwardly: eq. (4.4) can be rewritten, in this case, as 


Sr k = Q k k qk , (4.7) 

where Q k G 3? n<3,xnq is defined as Q = diag(£q&), while k qk G is a vector collecting joint stiffness 
values at sample k. Taking into account eq. (4.3), the system can be solved as follows 

K k = Qfe'T^ffe. (4.8) 

where T k is the tendon Jacobian matrix evaluated for the joint configuration vector q k . The solution of the 
linear system in eq. (4.8) is a vector containing hand joint stiffness values at sample k that allow to obtain a 
configuration variation Sq k of the hand when the tendons are pulled with a force variation 5f k - It is worth 
to observe that stiffness values depend on both joint displacement q and on tendon force f r . If we change 
the overall applied force to af r , where a > 0 is a generic scaling factor, the same joint configuration 
can be followed by scaling the stiffness matrix with the same scaling factor, i.e., with a stiffness matrix 
aK q . In other words, the shape of fingertip trajectories does not depends on K q absolute values, but rather 
on their relative ratios. Normalizing vector k q we obtain a base for the subspace of possible stiffness 
combination that can be used to track a desired trajectory. The values of K g are defined on the basis 
of material properties and geometry constraints in the design of hand finger, as we will better detail in 
Sec. III. The procedure described so far leads, in the general case, to a stiffness matrix that depends on 
hand configuration, i.e., K q = K g (q). Hand joints design to obtain a desired stiffness value may be not 
simple if the dependency of K g on q is significant. In the following, we will show an application in which 
we obtain stiffness values that slightly depends on hand configuration. 

Modular element modeling 

Let us assume that the generic finger, indicated with index j is realized by connecting n qj modules with the 
same geometric dimensions, but with different stiffness values. Let us assume, for the sake of simplicity, 
that each finger is actuated by a single tendon, let us indicate with tj its length variation. The analysis can 
be easily extended to hands actuated with multiple tendons. Let us indicate with l the length of the elastic 
element that constitute the joint, and with h the distance between the elastic element bending axis and the 
tendon when the joint is in its rest position. According to the modular approach proposed in this chapter, 
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we assume that this value is the same for all the joints, however the analysis can be easily extended to 
hands with different joints. 

Let us then consider a generic joint i on the finger j of the hand. The main geometrical parameters 
adopted in this section are summarized in Fig. 4.5. When the j-th tendon is pulled the elastic elements in 
the joints bend: let us suppose that the joint i is rotated by an angle q h — 0 t , the corresponding variation of 
tendon length in the joint is indicated with A l im We suppose that the bending elastic element assumes a 
circular arc shape, with radius r* = —, and we indicate with a* the arc chord, that can be evaluated as 

Qi 


ai = 2 ri sin ^. The corresponding variation of tendon length can be evaluated as 


A 7 7 / t\ , o • Qi (Ti-h 

A li = li - — (n-h) = 1 - 2 n sin — I —— 


(4.9) 


The overall tendon displacement can be expressed as the sum of all the variations over finger joints, i.e., 
tj = AZ*. We can observe that the relationship tj = tj (q) is nonlinear. The (j, i)-th element of the 

Jacobian matrix T introduced in eq. (4.2) can be evaluated as 


rp dtj fqi\ ( l \ k . (Qi\ 

3 ' V 2 ) V Qi ) a? V 2 J 


dqi V2 / \q t / q; 

For small values of qj , we can approximate (sin ~ and we have 


A L « hOi 


h. 


(4.10) 


(4.11) 


For a h/l ratio of about 0.2, i.e. the value that we adopted in the application that we will present in the 
following sections, the approximations in eq. (4.11) lead to an error on T l:J value within 5% for < 0.3 
rad. 


Passive joint design 

In this subsection, we focus on hardware realization of soft joints with a given stiffness. Our approach is 
inspired to the work presented in [101] for soft grippers composed of flexible and stiff parts. The model 
takes into consideration the geometric and material properties of the robotic device. The realization of 
soft gripper using closed-top molding techniques is further detailed in an open source platform named 
Soft Robotics Toolkit [102]. Differently from that work, we exploited mechanical properties of flexible 
materials and their dependency on fabrication methods so to obtain different stiffness values of flexible 
parts through the variation of the percentage of infill density, that can be regulated during the 3D printing 
phase. 

In this study, we furthermore follow a modular approach in the design: the basic idea is to realize 
modules composed of a flexible passive joint, in which the stiffness can be varied by properly regulating 
printing parameters, and a rigid link, which can be combined together to build underactuated soft robotic 
fingers. Using a sufficiently high number of modules, the deflection of each joint while the finger is 
bending is rather low, so that, for each joint, we can use the simplified linear results of beam theory. For 
higher deflections, a more complete bending model, as the one described in [103] should be adopted. 
When the actuator applies a force f r j through the j-th tendon, it produces on the joint i a torque r* = f rj h. 
We denote with S h the deflection of the elastic element realising the joint, that, according to beam theory, 
can be evaluated as 


Si = 


~frjhl‘ 

2 Ed 


(4.12) 
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Figure 4.5: Main geometrical parameters of the modular passive joint. 


where Ei is the Young’s modulus of the material, f is the second moment of area, and li is the length of 
the module elastic part. The corresponding joint rotation angle can be evaluated as 

Oi = (4.13) 

For the sake of simplicity we neglect the bending properties of the joint in the lateral and torsional direction. 
This simplification will be further validated through simulations in Sec. III. 

The rotational stiffness of the joint can be then evaluated as 



(4.14) 


Assuming both parts of the module as filled rectangular shape whose centroid is located at the origin, the 
second moment of area is given by 



(4.15) 


Referring to eq. (4.14), we can observe that different joints stiffness can be achieved by changing either 
the geometric or material parameters of the modules. Since we aim at realising a modular structure, we 
assume that the geometric parameters are the same for each module, i.e. f = /, k = /, hi = h. On the 
other hand, we can tune the material parameters in order to vary the modules stiffness. 


Actuator force evaluation 

In the stiffness design process, it is also important to evaluate the actuation force that is needed to bend the 
finger. The force applied by the actuator through the tendon produces a moment about the flexible part 
of the finger. The resultant behaviour can be approximated by a simplified cantilever beam model. The 
external forces acting on the finger are the force applied from the actuator and the interaction force which 
is represented in this model as a force applied on the fingertip Fu p . We can study the deflection effect 
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generated by the two forces separately by using the superposition principle. Let S a be the deflection due to 
the actuator applied force and S r be the deflection due to the reaction force 


_ f r hl 2 _ Ffipl 3 
2 El ’ r ZEI ' 


(4.16) 


The sum of both deflections can be equated to zero and the resultant equation is solved for F tip 


3f r h 

Fu P = -%-■ ( 4 - 17 ) 

Note that the terms E and I are cancelled out of the equation and as a result we do not need to consider 
the interaction between the alternating stiff and flexible parts of the modules to obtain the overall load at 
the fingertip. The model can be extended to any number of modules, as 


tip 


3 f r h 

2 eSA 


(4.18) 


Furthermore, we can consider the parasitic capstan effects that takes place between the cable and stiff 
parts as the robotic finger transforms to a curve shape. As the modules lose the colinearity during their 
motion, the cable imparts a reaction force that resists further actuation. We can include the capstan effect 
by considering the angle between subsequent stiff parts of modules The tendon does not pass 

through the flexible parts, so we can only consider the parasitic capstan effects on stiff parts. Thus, the 
fingertip force can be modified as 


Ftip — 



2n—2 



i=2,even 


where p is the friction coefficient. 

Finger module stiffness evaluation 

Looking at the interesting additive manufacturing techniques that nowadays are rapidly increasing and 
offering interesting new opportunities, we analyzed the possibility of tuning finger joint stiffness values 
through exploiting the potentialities of 3D printing fabrication methods. In particular, choosing a material 
as the Thermoplastic Polyurethane for realizing the flexible parts, we can get different stiffness values, 
while maintaining the same geometric shape, by regulating the percentage of infill density. This parameter 
affects primarily material density, but also its mechanical properties. As an example, Table 4.2 summarizes 
the variation of Young’s modulus E of the Thermoplastic Polyurethane as a function of the infill percentage 
density p [104]. 

For a given geometric structure of the joint, the corresponding stiffness value is therefore directly 
proportional to the infill density 

h = f(pi ). (4.19) 

As an example, we evaluated with the Finite Element Method (FEM) based software COMSOL the 
stiffness of a modular element varying material properties. The dimensions of the elements are: length 
l = 13 mm, thickness t = 2.5 mm, width w = 21 mm. Fig. 4.6 and Tab. 4.3 summarizes the main obtained 
results, in terms of stress and deformation of each module, and joint stiffness for different values of infill 
density percentage. Another parameter that we need to consider is the passive flexibility of the finger in 
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Table 4.2: TPU mechanical properties as a function of 3D printing infill density percentage, from [104]. 


Infill density p% 

E (MPa) 

10 

1.07 

30 

1.38 

50 

2.07 

70 

6.53 

90 

9.45 

100 

10.50 


Table 4.3: Results from FEM analysis of the passive joint, stiffness value as a function of infill density percentage of 
the material, for a given geometry. 


Infill density p% 

k(p) Nmm/rad 

ki Nmm/rad 

kt Nmm/rad 

10 

4.6930 

331.3 

24.9 

30 

6.0526 

427.2 

32.1 

50 

9.0789 

640.8 

48.1 

70 

28.6403 

2021.6 

151.7 

90 

41.4474 

2925.6 

219.7 

100 

46.052 

3807.9 

285.7 


the lateral direction and with respect to a torsional load, that cannot be controlled by actuators, and that 
could affect system functionality. We therefore evaluated also the stiffness of each module in the lateral 
direction, ki , and the torsional stiffness, k t . We reported the main results of this analysis in Fig. 4.6 and 
Tab. 4.3. We can observe that, for the given geometry, the lateral stiffness is much higher than the bending 
one, due to the module geometry, while the torsional one is closer. A finger composed of simple modules 
as those considered in this analysis may therefore have an excessive torsional compliance, that however 
could be potentially compensated by modifying the design of the rigid part of the model. 

Simulations 

To let the Soft-SixthFinger be able to grasp a wide range of objects, it is important to define a suitable finger 
flexion trajectory. To this aim, we took inspiration from the motion of the human hand. In particular, we 
used the mapping algorithm originally proposed in [45, 16] to transfer the motion of the human hand onto 
robotic hands with dissimilar kinematics. The mapping method allows to replicate on the Soft-SixthFinger, 
the effects in terms of motions and deformations that a human reference hand would perform on a virtual 
object. This allows to work directly on the task space avoiding a specific projection between different 
kinematics. Details of the mapping are not reported here for the sake of brevity, interested reader can refer 
to [45, 16]. We considered a model of a human hand augmented with a model of the robotic finger, see 
Fig. 4.7. We simulated using the Matlab SynGrasp toolbox [105] the motion of the human hand according 
to the first synergy as defined in [106]. We then computed the trajectory of the robotic fingertip using the 
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e) 


f) 


Figure 4.6: FEM model and stress/deformation analysis of the passive joint. In all the simulations, the left part of the 
flexible link was constrained to be fixed, while a load was applied to the rigid module connected to the right. Different 
loading conditions were applied to estimate the equivalent stiffness in different directions. The diagrams reported here 
summarizes the results obtained for the 100% of infill density, a, b): bending in the principal direction, a 5 N load was 
applied to the free boundary of the rigid module in the z direction, a) stress distribution, b) module deformation, c, d): 
bending in the lateral direction, a 5 N load was applied to the free boundary of the rigid module in the y direction, c) 
stress distribution, d) module deformation. e,f): torsion, a ±5 N load was applied to the free lateral boundaries, so to 
produce an equivalent torsional moment of about lOONmm with respect to the x direction, e) stress distribution, f) 
module deformation. 


mapping algorithm. This target trajectory in the Cartesian space is the result of the mapping of the first 
human hand synergy onto the robotic device. 
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Figure 4.7: The SynGrasp model of the human hand wearing the Soft-SixthFinger used to compute the joint stiffness 
values. 


Once a target trajectory is defined, we take advantage of the stiffness design presented in Sec. 4.3 to 
simulate a tendon driven underactuated finger able to track the desired fingertip trajectory. 

Considering polyurethane as material for the flexible joints, we computed the values for k g reported in 
Table 4.3. To obtain the desired trajectory, we need different stiffness values for each joint. Furthermore, 
for each joint, the evaluated stiffness is not constant, and depends on the level of synergy actuation, with a 
nonlinear behavior. Since: 1) it is not practically feasible to design the stiffness of each joint so that it 
follows the evaluated relation, 2) the stiffness variation for each joint for the proposed trajectory is low 
and 3) the trajectory shape depends on the ratios between the different stiffness values, rather than on 
their actual value, we then evaluated the trajectory obtained if each joint stiffness is assumed constant. 
The stiffness values and corresponding percentage infill density used are reported in Table 4.4. The range 
of stiffness values for the joints was decided according to the properties of the material used for the soft 
joints, i.e., a thermoplastic polyurethane (Lulzbot, USA) called “NinjaFlex”. We selected the range of 
values that were possible to replicate using that material and a 3D printer. We can therefore approximate 
the desired trajectory by realizing joints with different, but constant, stiffness values. 



Figure 4.8: Joint stiffness values necessary to generate the desired trajectory of the robotic sixth finger tip, evaluated 
according to Eq. (4.8), as a function of the corresponding actuation rate of the first synergy. 
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Table 4.4: Joint stiffness values computed by model for TPU material and corresponding infill density percentage 


Stiffness values (Nmm/rad) 

Infill density p% 

6.58 

14.3 

7.67 

16.7 

9.2 

20 

11.5 

25 

15.3 

33.4 

23.02 

50 

46.05 

100 


Once we have the target trajectory and the relative values of joint stiffness, we can use the proposed 
numerical model to study the kinematics of the tendon-driven Soft-SixthFinger and to simulate its fingertip 
trajectory. We simulated the model with the infill density percentage reported. 

The simulation results corresponding to the computed stiffness values are plotted in Fig. 4.9 and 
Fig. 4.10. In particular, Fig. 4.9 shows the bending deflection (^) and the angle (Of) for each module with 
respect to its local coordinates and the overall deflection of each joint with respect to global coordinates 
defined at the base of finger. On the other hand, Fig. 4.10 reports the plot of the actuator applied force to 
fingertip force. 

Experiments 

In order to experimentally validate our method, we realized two Soft-SixthFinger configurations with 
different stiffness at joint level. We 3D printed the flexible parts with different percentage of infill density 
to achieve different deflection in joints under same applied tendon force. In particular, one configuration 
was realized using the percentage reported in the previous Section, while for the other we used a common 
stiffness value for all the joints. We firstly evaluate the fingertip trajectories of the proposed configurations. 
We used a Vicon system (Vicon Capture Systems, UK) consisting of 8 cameras to track the fingertip 
trajectories. Six passive optical markers were used as reported in Fig. 4.11. The fingertip trajectory of 
the configuration with computed stiffness is reported in Fig. 4.12. The mean error between the simulated 
trajectory and the experimentally evaluated one was 0.023 m along x-axis and 0.021 m along y- axis, while 
the maximum error was 0.04 m and 0.027 m for x and y axes, respectively. This error is due to different 
factors including the 3D printed accuracy in density regulation, unmodelled friction between the tendon 
and the stiff part of the modules and small finger fluctuation during the flexion motion. 

In order to evaluate how the joints’ stiffness regulate the trajectory of the finger and, consequently, 
how the flexion trajectory influence the device adaptability to different shapes of the grasped objects we 
performed a qualitative experiment. A healthy subject was asked to wear the devices on its right arm, while 
simulating the paretic hand. Fig. 4.13 shows the snapshots of the two configurations of Soft-SixthFinger 
with different joints stiffness. The top configuration has the stiffness in each joint computed using the 
design method introduced in this chapter. The the bottom one shows the configuration with the same 
stiffness in the all the joints. 

Furthermore, to test the grasping ability of the device with the realized configurations, we used a 
subset of the objects included in the YCB grasping toolkit [107]. The objects were selected so to consider 
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-module 1 (base) 
module 2 
-module 3 
module 4 
module 5 
-module 6 
-module 7 (fingertip) 


Actuator Force [N] 



Actuator Force [N] 



Actuator Force [N] 


Figure 4.9: The simulation resultsilocal bending Si in each module vs. actuator force (top), local theta Oi for each 
module vs. actuator force (middle) and overall bending of each module with respect to the base module vs. actuator 
force (bottom), are shown. 


different object sizes and shapes. Fig. 4.14 shows the snapshots with some of the grasped objects with 
both configurations shown in Fig. 4.13. It was noticed that the configuration with the computed stiffness 
was able to perform better in terms of number of successfully grasped object, shape adaptation and grasp 
performance. 

Performance Characterization 

The device performances were evaluated through a subset of the tests proposed in [108]. In particular, we 
measured the maximum fingertip force, the maximum payload and maximum horizontal grasp resistive 
force. 

The maximum fingertip force of the device was recorded while fixing its support base on a table with 
the finger perpendicular to the table surface. The initial configuration of the finger was fully extended and it 
was commanded to close at the maximum torque. The hook of a dynamometer (Vernier, USA) was rigidly 
coupled with the fingertip of the device so that force could be measured in vertical direction as shown in 
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Figure 4.10: Simulation results of the actuator force (f r ) versus Fingertip Force ( Fu p ). 



Figure 4.11: The setup for fingertip tracking using the Vicon system. 
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Figure 4.12: Trajectory of the fingertip of the Soft-SixthFinger simulated (red) and experimentally evaluated (blue). 
Simulation are obtained using the model presented in Sec. II. Experimental data are obtained using an optical tracking 
system. 

Figure 4.15-(a). The constant applied force value at fingertip is presented in Table 4.5. The maximum 
horizontal grasp resistive force was measured by grasping an object (diameter=65 mm, weight=400 g) 
with the robotic device and the arm. The object was slowly pulled horizontally by using the hook of the 
dynamometer, see Figure 4.15-c. It was measured that the grasp remained stable till 13 N. To check the 
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Figure 4.13: Trajectories of the Soft-SixthFinger using different stiffeness at joint level. On top the joint stiffness is 
computed using the design method introduced in this study. On the bottom, the trajectory obtained considering all the 
joints with the same stiffness value. 



Figure 4.14: The soft-SixthFinger with two different trajectories grasping various objects with different shapes and 
sizes: (a) meat can, (b) coffee can, (c) strawberry, (d) soft ball (e) golf ball. 

maximum payload, an operator wore the grasp compensatory robotic device. The operator’s arm was 
stabilized on a table while grasping a cylindrical object (diameter=65 mm, weight=400 g) with the aid of 
the robotic tool at its maximum actuator’s torque. The grasped object was slowly pushed down using the 
dynamometer’s bumper as shown in Figure 4.15-(d). The maximum pushing force was recorded when the 
object started to slip. The maximum payload of the device (see, Table 4.5) is the sum of grasped object’s 
load and the one due to the pushing force. Figure 4.15-(b) and Figure 4.15-(e) show the minimum size 
graspable objects. The diameter of the smallest graspable object is reported in Table 4.5. 

The double soft sixth finger 

Although the soft sixth finger can be used to grasp and stabilize a large set of objects, having a single finger 
in opposition to the patient arm can result in a limitation in tasks requiring a high payload. We designed 
the double soft sixth finger to deal with these particular situations. The double soft sixth finger shares with 
the soft sixth finger the same principle design guidelines related to wearability, modularity, symmetrical 
structure and underactuation. It is composed by two parts: a support base that allows the finger to be worn 
at the patient forearm and two fingers. The angle between the two finger has been selected so to maximize 
the distance between the two fingertips, while not exceeding the support base size. The exploded view of 
unit module and complete double soft sixth finger is shown in Figure 4.16. Two tendon wires (one for 
each flexible finger) and a single actuator control the motion of the device. One end of each tendon wire is 
fixed to each fingertip, while the other ends of both tendon wires are attached to a single pulley mounted 
on the shaft of the actuator (MX-28T). When the motor rotates, both tendon wires are wound on the pulley 
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and fingers are flexed to grasp the object. As the motor is rotated in opposite direction, the elastic parts 
in the joints restore the finger to its extended configuration. We performed similar evaluation for double 
soft sixth finger to quantify its payload, maximum fingertip force and horizontal grasp resistive force. The 
results of the experiments are shown in Table 4.5. The approach of building compensatory robotic device 
using two robotic fingers improved the payload and horizontal grasp resistive force which in turn can 
handle relatively heavier objects. The shape adaptation to the grasped object was also confirmed by using 
the objects in the YCB toolkit. 




Figure 4.15: Experimental procedure to measure the performance characteristics of the soft sixth finger. The Figure 
(a), (c), (d) show the experimental setup for maximum fingertip force, horizontal grasp resistive force and maximum 
payload, respectively. The arrow in figure show the direction of applied force. Figure (b) and (e) show the minimum 
size graspable objects. 




Upper Base 
Support Elastic Band 
-Lower Base Support 


Figure 4.16: The CAD exploded view of the double soft sixth finger. On the left unit module with single tendon. On 
the right, the exploded view of complete double soft sixth finger. 
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Table 4.5: Technical details of the Soft Sixth Finger (SSF) and the Double Soft Sixth Finger (DSSF) 


Dimensions 


Module 

20 x 31 x 12 mm 3 

Total length of finger (on arm) 

180 mm 

Support base 

110 x 63 x 3.5 mm 3 

Actuator control unit box 

71 x 71 x 45 mm 3 

Weights 


Module 

4g 

Actuator control unit box 

146 g 

Actuator 


Max. torque 

3.1 Nm @ 12 V 

Pulley radius 

8 mm 

Max. current 

1.4 A @ 12 V 

Continuous operating time 

3.5 h @stall torque 

Max. operating angles 

300 deg, endless turn 

Max. non-loaded velocity 

684 deg/sec 

The SSF performances 


Max. Force at fingertip 

40 N 

Max. payload 

2.4 kg 

Max. horizontal resistive force 

13 N @ dia=65 mm 

Total: finger + support base 

180 g 

Diameter smallest graspable obj. 

14 mm 

The DSSF performances 


Max. Force at fingertip 

15 N 

Max. payload 

4.87 kg 

Max. horizontal resistive force 

26 N @ dia=65 mm 

Total: finger + support base 

230 g 

Diameter smallest graspable obj. 

17 mm 


Wearability and device positioning at forearm 

The actuator’s controller and battery have been enclosed in a small box to be worn on the patient’s belt. 
Only the device and its actuator are placed at the patient’s forearm to keep minimum weight on it. 

The device can be worn by the user without any assistance, just inserting their hand/arm between the 
two base parts. Then, using the velcro elastic band, the patient can tight the device at the forearm. The 
robotic devices can be wrapped up on the arm as bracelets to reduce the encumbrance when being not 
used as shown in Figures. 4.17. The patient can use his or her healthy hand to switch from the rest to the 
working position and viceversa. The switching between the two positions is achieved through a passive 
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Figure 4.17: The Soft-SixthFinger in rest and working position. The robotic extra-finger works with the paretic limb 
to compensate for hand grasp functionality. 

rotatable Dovetail triangular locking mechanism. The mechanism consists of two parts, namely A and 
B. Part A is embedded on the support base while part B is contained in the finger starting module. After 
coupling both parts together, a pin joint has been added in the center of both parts to allow only rotation 
while constraining the decoupling of both parts without unscrewing the pin joint. The mechanism has 
two locking positions. The locking positions are set at the working and rest positions of the extra fingers. 
Apart from wearability and ergonomics, the device position at the forearm plays an important role in the 
task performance. The location of the device depends on the patient conditions and on the residual mobility 
of the arm/hand. The compensatory robotic devices can be worn on the distal part of the forearm (near 
or on the wrist), so to obtain the grasp by opposing the device to the paretic hand. However, the distal 
position of the robotic finger may fail when the motor deficit is so advanced that a pathological synergism 
in flexion has taken place. In this case, the wrist and fingers are too much flexed not allowing successful 
grasping. When this pathological condition occurs, the extra-finger may be positioned more proximal at 
the forearm, so to let the grasp be achieved by the extra-fingers opposition to the radial part of the wrist. 
This flexibility in the positioning is achieved thanks to the symmetrical structure and the ergonomics of 
the support base. The support base of the fingers can be translated or rotated along the forearm to place 
the finger on a suitable orientation. These features enable the device to adapt the patient conditions and 
increases the versatility of the device. Moreover, the elastic straps along with velcro enable the devices 
to fit to different size of arms and facilitates the patients in wearing robotic device himself without any 
assistance. 


4.4 Tests with chronic stroke patients 

We performed a series of experiments with five chronic stroke patients (four male, one female, age 40 — 62) 
to prove the effectiveness of the devices in grasp compensation. Written informed consent was obtained 
from all participants. The procedures were in accordance with the Declaration of Helsinki. We targeted 
ADL bi-manual tasks to evaluate if the compensatory robotic devices can assist the patients. In order to 
use the proposed devices, the subjects should have residual mobility of the arm. For being included in 
the experimental phase, patients had to score < 2 when their motor function was tested with the National 
Institute of Health Stroke Scale (NIHSS) [78], item 5 “paretic arm”. Moreover, the patients had to show 
the following characteristics: normal consciousness (NIHSS, item la, lb, lc = 0), absence of conjugate 
eyes deviation (NIHSS, item 2 = 0), absence of complete hemianopia (NIHSS, item 3 < 1), absence of 
ataxia (NIHSS, item 7 = 0), absence of completely sensory loss (NIHSS, item 8 < 1), absence of aphasia 
(NIHSS, item 9 = 0), absence of profound extinction and inattention (NIHSS, item 11 < 1). The goal of 
the tests was to evaluate how quickly the patients could learn to use the devices and which device they 
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preferred to fulfill a certain task. The patient were asked to select between the soft sixth finger and the 
double soft sixth finger to perform the proposed tasks. Patients wore the robotic device on their paretic 
limb, on the left for two subjects and on the right one for the other three. The rehabilitation team assisted 
the subjects during a training phase that lasted about one hour. During this phase, the optimal position of 
the device on the arm was evaluated according to the patient motor deficit. After the training phase, the 
subjects were asked to perform a list of bi-manual tasks with the aid of proposed devices. We proposed 
the patients three possible scenarios. The first included two different kitchen activities involving multiple 
bi-manual tasks. In the second, we tested the device with bi-manual tasks using tools. Finally, we tested 
the use of the robotic extra fingers to carry a shopping bag while walking. 

Kitchen Scenario 

Cooking in the kitchen involves a variety of bi-manual tasks and many of them are based on hold and 
manipulate techniques. The compensatory robotic devices can support the patients in performing such 
tasks even if one hand is paretic. Figure 4.18 and Figure 4.19 show the snapshots of the tasks performed 
by the subjects to prepare the breakfast and lunch. 

Preparing breakfast 

We asked the patients to simulate the activities of preparing coffee, putting jam on bread slice and peeling 
apple for breakfast. 

Task 1 “Opening the coffee pot”\ Hold firmly the base of coffee moka pot with the help of robotic device 
while use healthy hand to unscrew the upper part (see, Figure 4.18-a). 

Task 2 “Closing the coffee pot”\ Fill the filter with a mixture of coffee grounds. Grasp the base part with 
the device and close the pot again. 

Task 3 “Pouring coffee into cup”: pour coffee using healthy hand while holding cup with the compensatory 
device (see Figure 4.18-b). 

Task 4 “Opening jam jar”: grasp the jar with the device and non-functional arm while opening the cap 
with functional one. 

Task 5 “Spreading jam on bread”: grasp the jamjar to take jam from it by holding the knife in healthy 
hand. Spread jam on a bread slice using functional hand(see, Figure 4.18-c). Task 6 “Peeling apple”: 
grasp the apple with device and peel it using knife in the healthy hand(see, Figure 4.18-d). 

All the patients choose the soft sixth finger to perform the task, since the single finger results more suitable 
while manipulating relatively light weight and smaller objects. 

Preparing lunch 

Task 1 “Opening tomato sauce jar”: constrain the motion of the tomato jar with the device and paretic 
arm while the healthy hand unscrews its cap (see, Figure 4.19-a). 

Task 2 “Pouring”: pouring the tomato sauce from its jar into a cooking pot. 

Task 3 “Opening tuna can”: hold the tuna can with the device while functional hand open its cap (see, 
Figure 4.19-b). 

Task 4 “Opening beans can”: constrain the motion of beans can with compensatory robotic device and 
paretic arm while the healthy hand open its cap. 

Task 5 “Pouring”: Pouring the beans from its can into a cooking pot. 

Task 6 “Stirring”: hold firmly the cooking pot with the compensatory robotic device while functional hand 
stirrs the food in it (see, Figure 4.19-c). 

Task 7 “Opening yogurt cup”: constrain the yogurt cup and remove its cover (Figure 4.19-d). All patients 
decided to use the double soft sixth finger to perform tasks (a) and (c), while the soft sixth finger was 
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Figure 4.18: Preparing breakfast with the help of grasping compensatory tool.(a) opening the Moka pot, (b) pouring 
coffee into cup, (c) spreading jam on bread, (d) peeling apple 


Figure 4.19: Preparing lunch with the help of grasping compensatory robotic device, (a) opening tomato sauce jar, (b) 
opening tuna can, (c) stirring food, (d) opening yogurt cup 


selected to complete tasks (b) and (d). Snapshots of the execution of the tasks are reported in Figure 4.19. 
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Figure 4.20: Using different tools in bi-manual tasks with the aid of robotic device, (a) drilling in wood block, (b) 
removing nail using claw hammer (c) inserting tapcon screw (d) tightening or loosening bolt 

Tools Activities 

The tools activities are another example of ADL where many tasks are based on hold and manipulate 
principle. The presence of the compensatory robotic device can help the patient to complete such bi-manual 
tasks even if one hand is non-functional. We asked the patients to use the tools to perform the following 
tasks. 

Task 1: “Drilling in wood block”: grasp the wood block with the device and impaired arm. Drill a hole in 
the wood block while using drilling machine in healthy hand (see, Figure 4.20-a). 

Task 2: “Removing nail using claw hammer”: hold firmly the wood block with the compensatory robotic 
device and paretic arm. Use claw-hammer in healthy hand to pull the nail from the wood block (see, 
Figure 4.20-b). 

Task 3: “Inserting tapcon screw in the drilled hole”: use device and non-functional arm to hold the object 
of drilled hole. Place the tapcon screw at hole position, use screw driver in functional hand to screw it until 
it is completely inserted in the hole (see, Figure 4.20-c). 

Task 4: “Tightening or loosening bolt using wrench key”: constrain the object with the device and paretic 
arm and use wrench key in healthy hand to tight or loose the bolt (see, Figure 4.20-d). double soft sixth 
finger was used in all tasks to assure stable and firm grip on the wood block. All patients selected the 
double soft sixth finger to perform the tasks. 

Active Hook 

The last application proposed was to carry shopping bag with the compensatory robotic device while 
walking as shown in Figure 4.21. The patients were successfully able to carry the bag using robotic devices 
on paretic arm. As expected, double soft sixth finger was able to carry heavier bag as compared to the soft 
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Figure 4.21: Carrying shopping bag with the help of grasping compensatory robotic device, 
sixth finger due to its higher payload. 

Questionnaires 

After the experiments, we asked the patients about the usefulness and possible concerns related to the 
compensatory robotic devices for performing ADL tasks. The patients were asked to fill the Usefulness- 
Satisfaction-and-Ease-of-use questionnaire (USE, [109]) that focuses on the experience of the system 
usage. This questionnaire uses a seven-point Likert rating scale. Mean and standard deviation (SD) of 
the questionnaire factors are presented in Table 4.6. Moreover, to evaluate the patient’s satisfaction to the 

Table 4.6: Questionnaire factors and relative marks. The mark ranges from “1 — strongly disagree” to “7 = strongly 
agree”. Mean and standard deviation (Mean (SD)) are reported. 


Questionnaire factors 

Mean (SD) 

Usefulness 

5.6(0.8) 

Ease of use 

6.0(0.6) 

Ease of learning 

6.5(0.8) 

Satisfaction 

5.8(0.7) 


proposed compensatory devices and their features, we asked the patients to fill the first part of the QUEST 
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2.0 questionnaire [110]. The purpose of the QUEST questionnaire is to evaluate how satisfied patients are 
with the proposed assistive device. The mark ranges from “1 = not satisfied at all” to “5 = very satisfied”. 
Mean and standard deviation (Mean (SD)) are reported in Table 4.7. 

Table 4.7: Quebec User Evaluation of Satisfaction with assistive Technology. The mark ranges from “1 = not satisfied 
at all” to “5 as very satisfied”. Mean and standard deviation (Mean (SD)) are reported. 


How satisfied are you with 

Mean (SD) 

the dimensions (size, height, length, width) 
of your assistive device? 

4.6(0.8) 

the weight of your assistive device? 

4.0(0.6) 

how safe and secure your assistive device 
is? 

4.5(0.8) 

the durability (endurance, resistance to 
wear) of your assistive device? 

4.6(0.7) 

how easy it is to use your assistive device? 

4.6(0.7) 

how comfortable your assistive device is? 

4.2(0.7) 

how effective your assistive device is (the 
degree to which your device meets your 
needs)? 

4.0(0.8) 


4.5 Results and discussion 

The ergonomics and functional requirements listed in Table 4.2 have been considered in the design and 
development of the robotic devices. Table 4.5 summarizes the devices achieved requirements. 

Table 4.8: How the proposed robotic devices meet the ergonomics and functional requirements listed in Table 4.2 


Category 

Requirement 

Actual realization 

Ergonomics 




Extreme Wearability 

The devices can be worn through sup¬ 
port base and can be shaped into 
bracelet when being not used. 


Portability 

Portable complete system including 
power supply and actuator control unit. 
The wireless communication between 
eCap and robotic device. 


Weight 

Maximum 230 g at arm. 
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Ease of use 

Ease in wearing is realized by eCap, 
support base and elastic straps. Easy 
working principle and few control in¬ 
puts from user. 

Functional 




Robustness 

The intrinsic compliance and flexible 

structure. 


Fatigue avoidance 
and safety 

No mechanical forces by robotic device 
on impaired hand. Light in weight. 


Device adaptability to 
patient 

Adaptable in terms of positioning and 
left/right hemiparetic upper limb with 
different sizes. 


Control interface 

adaptability to patient 

Auto-tuning calibration to better match 
the user-dependent nature of the EMG 
signal. 


Device coupling with 
human arm 

Devices firm grip at forearm by cou¬ 
pling of two rigid parts of support base 
having silicon skin to increase friction 
and two parallel velcro strap to tight 
both parts at the arm. 


Object shape adapt¬ 
ability 

Underactuation and passive compliance. 


Mechanical power 

Actuator with Controllable mechanical 
power (torque). 


Configurability 

Modular design, easy modules assem¬ 
bly (flexible part slides in stiff part). Se¬ 
lectable desired control interface, i.e., 
EMG or push button. 


Functional versatility 

Devices functionality ranging from clin¬ 
ical needs to various indoor and outdoor 

ADL tasks. 


Energy efficiency 

Rechargeable light weight portable bat¬ 
teries. Actuator capability to maintain 
the stall torque at minimum current con¬ 
sumption. 


Error tolerance 

Underactuation, passive compliance and 
high friction through silicon skin at pos¬ 
sible contact points. 
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Simple and intuitive Trigger signal based simple control, 
interfaces LEDs mounted visual feedback control 

board for further intuitive interface. 


The robotic extra fingers have been tested with different targets in order to demonstrate how the soft 
fingers can adapt to the shape of the object, producing a stable enveloping grasp. We tested the device 
with five chronic stroke patients in ADL. The proposed robotic devices successfully enabled the patients 
to complete all the presented bi-manual tasks. The experiments authenticated that the presented robotic 
devices can be an effective aid for chronic stroke patients to perform simple ADL tasks. The patients 
questionnaire feedback showed the effectiveness of the proposed compensatory robotic devices in assisting 
ADL tasks. The proposed robotic devices resulted to be an effective aid in completing the ADL bi-manual 
tasks. If compared to the old versions of the device, the soft sixth finger showed better performance due to 
the new actuation, the more stable support base and the increased friction at contact points. The realization 
of a new device, the double soft sixth finger, increased the potential use of compensatory devices in the 
ADL tasks, since it is able to realize a more stable grasp in relatively more payload demanding and pouring 
tasks. At this early stage of research we cannot determine which device is better to fulfill a certain task. 
The soft sixth finger resulted more easy to use when it is necessary to grasp small objects. It is also more 
wearable and portable with respect to the version with two fingers. On the other hand, the double soft sixth 
finger has an higher payload and can be used in more complicated manipulation tasks, such us pouring 
water from a bottle. This improvement on grasp stability come at the cost of an higher weight and a reduced 
wearability. We believe it is worth exploring both the solutions in different applications and different tasks 
and keep developing the two platforms in collaboration with the clinicians and the patients. Although the 
experiments with patients showed the effectiveness of the devices in the completion of some ADL, at the 
moment this approach has some limitations. Patients suffering from hemiplegia or hemiparesis can vary 
over a wide range, from mild weakness and loss of dexterity in the fingers to complete paralysis in the left 
or right side of the body. Although the proposed compensatory devices are able to compensate in terms of 
grasping, the use of the device require some mobility in the impaired arm with even non-functional hand. 
Complex manipulation bi-manual tasks like tying shoelaces or buttoning, are too demanding and out of 
scope of both selected group of patients and current devices. However, many ADL tasks including those 
presented in the chapter, can successfully be completed with the aid of proposed robotic devices . 


4.6 Conclusion 

This chapter presents design, analysis, manufacturing, experimental characterization and evaluation of 
two prototypes of soft robotic extra fingers that can be used as grasp compensatory robotic devices for 
hemiparetic upper limb. An approach is illustrated to to model the kinematics and the passive stiffness of 
flexible grippers and its realization in order to follow a desired trajectory for the finger. It explored the role 
of stiffness in grasping performance and demonstrated a novel method which is applicable to any tendon- 
driven, underactuated and passively compliant hand. The grasping performance of such grippers mainly 
depends on their intrinsic characteristics, e.g., passive joint compliance, instead of relying on active control 
for compliance used in complex manipulators. Firstly, a procedure to determine suitable joints stiffness is 
defined and then a possible realization in robotics fingers hardware structure is proposed. Without any loss 
of generality, It proposes a modular approach to define robotic hands. In most of the solutions existing 
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in the literature, the hand is composed of a series of identical fingers, and the modularity is exploited at 
the finger level while we propose each phalanx built with same modules, i.e., a flexible joint and a rigid 
link. The model is built using theory of mechanics of tendon-driven hands coupled with beam theory. The 
feasibility of the approach was demonstrated through a framework composed of both simulations and 
exploitation of model in the realization of the Soft-SixthFinger. The experiments revealed that modelling 
joint stiffness and its realization using the proposed method improved the grasping performance and shape 
adaptation to a wider set of objects. Obviously, the presented approach can also reduce the manufacturing 
iterations needed to optimize the joints stiffness. Moreover, the proposed mathematical framework can 
also be used in continuum hands modelling (e.g., RBO hand) by further discretize the joints and links 
distribution. The devices are developed using rapid prototyping 3D printer and moulding techniques, the 
devices are tested with chronic stroke patients through qualitative experiments based on ADL. 



Chapter 5 

Wearable sensory motor interfaces for supernumerary robotic 
fingers 


Touch comes before sight, before speech. It is 
the first language and the last, and it always 
tells the truth. 

Margaret Atwood, Der blinde Morder 

This chapter presents the design and development a new generation of extremely wearable haptic 
interfaces, acting as sensorimotor interfaces between the human wearer and the supernumerary robotic 
fingers. The small size and the specific shape of the developed devices guarantees an easy and intuitive 
wearability and leave the user’s fingertips bare in order to not constraint the user’s interaction with the 
surrounding environment in any way. Based on psychophysics evaluations, our novel interfaces deliver 
information about the cooperative task being performed (e.g., quality of the grasp) and the state of the 
extra-finger(s) where they are expected, providing the subject with a direct and co-located perception of the 
haptic feedback. Although the richness of the delivered information is very important, we strongly believe 
that sensorimotor consistency is crucial to design natural and embodied interfaces. In particular, two kinds 
of interfaces namely ’’vibrotactile ring” and hRing are proposed. The human user is able to control the 
motion of the robotic finger through switchs placed on rings, while being provided with vibrotactile and 
cutaneous feedback about the forces exerted by the robotic finger on the environment. To understand how 
to control the vibrotactile and cutaneous interface to evoke the most effective sensations, we executed 
perceptual experiments to evaluate its absolute and differential thresholds. We also carried out experiments 
with the subjects and haptic feedback significantly improved the performance in task execution in terms of 
completion time, exerted force, perceived effectiveness and wearability. 

This Chapter is an extended and revised version of the work published in [19, 111, 112] 


5.1 Introduction 

Beyond design guidelines, another interesting issue is how to interface the extra finger with the human 
hand motion. In [16], we presented a possible control strategy able to transfer to one or more extra fingers a 
part or the whole motion of the human hand. We considered an extension of the mapping method proposed 
in [45, 48] to the case of a human hand augmented with a robotic extra finger. A commercial dataglove was 
used to measure the hand configuration during a grasping task. Although this control approach guarantees 
a reliable tracking of the human hand and can be extended to more fingers, there are two main drawbacks 
to be solved. First, the user lacks a feedback of the robotic finger status and can only perceive the force 
exerted by the device mediated by the grasped object. The second problem is related to the approaching 
phase of the grasp. In fact, the algorithm presented in [16] considers the motion of the whole hand to 
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Vibrotactile 

motor 



Figure 5.1: The robotic extra finger together with the vibrotactile interface ring. The ring provides haptic feedback 
through a vibrating motor and enables the user to start and stop the finger motion through a switch. 

compute the motion of the extra finger, thus limiting the possibility of the user to make fine adjustments to 
adapt the finger shape to that of the grasped object. 


5.2 Vibrotactile haptic feedback for intuitive control of supernu¬ 
merary robotic fingers 

We firstly addressed these issues by introducing a vibrotactile interface that can be worn as a ring as shown 
in Fig. 5.1. The human user receives information through the vibrotactile interface about the robotic 
finger status in terms of contact/no contact with the grasped object and in terms of force exerted by the 
device. Haptic stimuli have been indeed proved to enhance the performance of robotic systems in many 
scenarios [113, 114]. However, most robotic systems with force reflection provide force feedback through 
grounded haptic devices, such as the Omega (Force Dimension, Switzerland) interfaces. Although these 
devices can be very accurate and able to provide a wide range of forces, their form factor makes them not 
suitable to be used in wearable applications, where the system needs to be lightweight, small, and easy 
to wear [115]. For this reason, we designed a custom wearable vibrotactile interface, since vibrotactile 
stimuli convey rich information and have an extremely compact form factor with respect to more popular 
grounded interfaces [116, 117, 118]. 

Regarding the grasp approaching phase, we introduce a new control strategy that enables the finger to 
autonomously adapt to the shape of the grasped object. We developed a new finger prototype with 3 DoFs 
and three modules to resemble the kinematics of the human finger. Each module has been equipped with a 
force sensor able to detect contacts with the grasped object. We defined a grasping procedure that starts 
from a predefined position, when the robotic finger is open at its maximum. As soon as one module is in 
contact with the object, that module stops its motion, while the others keep moving toward the object. The 
details of the closing procedure will be described in Sec. 5.2. The procedure can be activated by pressing 
the switch placed on the interface ring (see Fig. 5.1). This approach dramatically simplifies the interaction 
with the robotic finger, reducing it to the activation of a grasping procedure through the wearable switch. 
This shared autonomy between the user and the device has been kept also in the control of the exerted force. 
We developed a variable compliance control that let the finger adapt its stiffness according to the force 
necessary to guarantee a stable grasp. The user is provided through the vibrating ring with information 
about the exerted forces and, therefore, about the finger compliance. 
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Figure 5.2: CAD models of the vibrotactile interface and of the modular finger. Three single DoF modules are 
connected to a wrist elastic band. The ring is equipped with a push button which is used as an interface with the user 
and a vibrotactile motor to provide an haptic stimulus. 


We tested the system in a pick and place task where users were asked to move an object between 
two predefined positions by taking advantage of the extra finger. We demonstrated that haptic feedback, 
together with the intuitive human robot interface, enhances users’ performance in terms of completion time 
and exerted force. The rest of the paper is organized as it follows. Section 5.2 describes the extra finger 
and the ring interface. Section 5.2 presents two preliminary experiments aiming at evaluating the absolute 
and differential thresholds of our vibrotactile haptic device. Section 5.5 deals with the pick-and-place 
experiment carried out to evaluate the effectiveness of the system, while in Section 5.2 conclusion and 
future work are outlined. 


Sensorized supernumerary robotic finger 

The robotic finger presented in Chapter 2 is modified to equip the modules with force sensors and position 
feedback. In particular, a Force Sensing Resistor (FSR) (408, Interlink Electronics Inc., USA) is placed 
on each module, as reported in Fig. 5.2. These sensors will be used for the closing procedure and the 
compliance variation described in Sec. 5.2. The servo motor of each module is modified in order to acess 
the reading of internal potentiometer for the actual position of the motor. The vibrotactile ring interface 
is designed to be worn on the index finger of the human hand, see Fig. 5.1. The ring is equipped with a 
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Figure 5.3: Compliance behavior of a single module with different value of kd. Force vs displacement is plotted. The 
force is measured using FSR sensor and the displacement is recorded by the position feedback of the modified servo 
motor. 

switch and a vibro motor, as shown in Fig. 5.2. The ring housing is 3D printed. The motor used is an 
eccentric rotating mass vibrotactile motor (Precision MicroDrives, United Kingdom). The switch is used 
to start the finger closing procedure, as described in Sec. 5.2, and move the finger back to the initial grasp 
position. The vibrotactile motor is used to provide vibrotactile feedback, as explained in Sec. 5.5. 

Grasping procedure and compliance regulation 

The user can command the finger motion by using the wearable switch placed on the ring. When the 
switch is activated, the finger starts to close with a fixed joint angle increment, equal in each module, from 
a predefined position. We considered the completely extended finger as the starting position to enlarge the 
set of possible graspable objects. 

During the grasping phase, the FSR sensors are in charge of detecting the contact of each module with 
the grasped object. In order to have suitable contact points, we set different closing priorities for each 
module. If the distal module (see Fig. 5.2b) comes in contact first, the remaining two modules stop. If 
the intermediate module gets in contact first, only the proximal one stops, while the distal module keeps 
moving. Finally, if the proximal module comes in contact first, two different behaviors can occur: (1) 
the intermediate module gets in contact first and the distal one is free to move to get in contact with the 
object, (2) the distal module comes in contact first and then also the intermediate one stops. The grasping 
procedure is commanded by the user acting on the switch. When the grasp is complete, the finger starts to 
autonomously keep the grasp stable. This grasp stabilization is obtained by controlling the compliance of 
each module. The compliant behavior of a module with different values of the scaling factor kd is reported 
in Fig. 5.3. The force at each module is measured by using the FSR sensor. The compliance decreases 
with the increase of kd . The basic idea is that the module can change its compliance according to the force 
observed by each module through the relative FSR sensor. Thus, when the user pushes the object toward 
the extra finger to tight the grasp, the device becomes stiffen The possibility to independently regulate 
each module’s compliance allows to adapt the finger to the the shape of the grasped object also during 
manipulation tasks. Similar to what we did for the grasping procedure, we set the same priorities between 
the three modules also regarding the compliance variation. When the user wants to release the grasped 
object, he just needs to lower the force exerted by his hand on the object and, automatically, the robotic 
device will make its joints more compliant. Eventually, by pressing again the switch, the robotic finger 
moves back to its home position by following a predefined trajectory. 
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Figure 5.4: Performance characteristics of the Precision Microdrives 4 mm Vibration Motor (11 mm type). 
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Figure 5.5: Absolute threshold. Mean values and standard errors of the mean (SEM) are plotted. The relationship 
between input voltage, and the amplitude and frequency of the vibration can be found in Fig. 5.4. 

Absolute and differential thresholds 

In order to understand how to drive the vibrotactile ring correctly to evoke the most effective cutaneous 
sensations, we ran two preliminary experiments aiming at evaluating the absolute and differential thresholds 
of our device. The motor we use is an eccentric rotating mass vibrotactile motor, and it is not possible 
to separately control amplitude and frequency of vibration. The relationship between input voltage, and 
the amplitude and frequency of the vibration is shown in Fig. 5.4. Subjects were required to wear the 
vibrotactile ring on their right index proximal phalanx. Moreover, to avoid any additional cue, subjects 
were blindfolded and wore noise-canceling headphones. The absolute threshold can be defined as the 
“smallest amount of stimulus energy necessary to produce a sensation [119], and it gives us information 
about the smallest vibration we need to provide in order to produce a perceivable sensation by the human 
user. Six participants took part in the experiment. The experimenter explained the procedures and spent 
about three minutes adjusting the setup to be comfortable before the subject began the experiment.We 
evaluated the absolute threshold by using the simple up-down method [120]. We used a step-size of 0.08 V, 
which reduced of 0.02 V every reversal. We considered the task completed when four reversals occurred. 
Subjects were required to wear the cutaneous device as shown in Fig. 5.1 and tell the experimenter when 
they felt the stimulus. Each participant performed forty-eight repetitions of the simple up-down procedure, 
with six repetitions for each considered duration of the vibratory stimulus: 13 ms, 25 ms, 37 ms, 50 ms, 
100 ms, 150 ms, 200 ms, and 250 ms. Fig. 5.5 shows the absolute thresholds averaged over all subjects. 
The differential threshold can be in turn defined as “the smallest amount of stimulus change necessary to 
achieve some criterion level of performance in a discrimination task” [119]. This gives us information 
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Figure 5.6: Differential threshold. Mean values and standard errors of the mean (SEM) are plotted. The relationship 
between input voltage, and the amplitude and frequency of the vibration can be found in Fig. 5.4. 

about how much different two vibrations provided with our device need to be in order to be perceived as 
different by the human user. This threshold is often referred to as just-noticeable difference or JND. The 
differential threshold of a perceptual stimulus reflects also the fact that people are usually more sensitive to 
changes in weak stimuli than they are to similar changes in stronger or more intense stimuli. The German 
physician Ernst Heinrich Weber suggested the simple proportional law JND = kl , suggesting that the 
differential threshold increases by increasing the intensity / of the stimulus. Constant k thus referred to as 
“Weber’s fraction”. The experimental setup was the same as described in Sec. 5.2. Nine participants took 
part in this experiment. As in Sec. 5.2, the experimenter explained the procedures and spent about three 
minutes adjusting the setup to be comfortable before the subject began the experiment. We evaluated the 
differential threshold using again the simple up-down method [120]. We used again a step-size of 0.08 V, 
which reduced of 0.02 V at every reversal. We considered the task completed when four reversals occurred. 
Subjects were required to wear the cutaneous device and tell the experimenter when the two vibrations 
provided felt different. We tested the JND at three reference stimuli: 0.45 V, 0.7 V, and 1.2 V, which 
corresponded, respectively, to vibrations of amplitude 0.15 g, 0.30 g, and 0.62 g, and of frequency 68 Hz, 
100 Hz, and 160 Hz (see Fig. 5.4). We considered also three different vibration lengths: 100 ms, 150 ms, 
and 200 ms. We did not consider lengths < 100 ms to be sure that everyone would be able to perceive 
them at all reference stimuli (see Fig. 5.5). The results observed are in agreement with previous results 
in the literature [121]. Each participant performed eighteen trials of the up-down procedure, with two 
repetitions for each of reference stimulus and vibration length considered. Fig. 5.6 shows the differential 
thresholds averaged over all subjects. For the reference stimuli of 0.45 V, 0.7 V, and 1.2 V, and a vibration 
length of 100 ms, the average JNDs are 0.19 V, 0.29 V, and 0.48 V, respectively. Thus, the Weber fractions 
are 0.42, 0.42 and 0.40, respectively, following Weber’s Faw. For the reference stimuli of 0.45 V, 0.7 V, 
and 1.2 V, and a vibration length of 150 ms, the average JNDs are 0.15 V, 0.23 V, and 0.38 V, respectively. 
Thus, the Weber fractions are 0.34, 0.33 and 0.32, respectively, following Weber’s Faw. Finally, for the 
reference stimuli of 0.45 V, 0.7 V, and 1.2 V, and a vibration length of 200 ms, the average JNDs are 
0.11 V, 0.18 V, and 0.32 V, respectively. Thus, the Weber fractions are 0.25, 0.26 and 0.27, respectively, 
following Weber’s Faw. 

Experimental evaluation 

In order to evaluate the effectiveness of our extra finger device and the usefulness of vibrotactile haptic 
feedback, we carried out a pick-and-place experiment. The experimental setup was composed of our 
robotic extra finger device, the vibrotactile ring, and a cylinder, as shown in Fig. 5.7. The cylinder was 
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Figure 5.7: Experimental setup. The task consisted of grasping the cylinder from its starting position, lifting it from 
the table, and moving it to its final position, being as fast as possible. The cylinder had a radius of 7.5 cm and a height 
of 15 cm. 

made of ABSPlus, it had a radius of 7.5 cm, a height of 15 cm, and a weight of 150 g. The robotic extra 
finger device was controlled as detailed in Sec. 5.2. The task consisted of grasping the cylinder, lifting 
it from the table, and moving it 45 cm right, being as fast as possible. The initial and final positions of 
the cylinder were marked on the table by two red circles (see Fig. 5.7). Ten participants took part in the 
experiment. The experimenter explained the procedures and spent about five minutes adjusting the setup to 
be comfortable before the subject began the experiment. Each participant made twenty randomized trials 
of the pick-and-place task, with five repetitions for each feedback condition proposed: 

• vibration bursts on making and breaking contact with the grasped object and when close to the 
actuators’ force limit (condition V m &), 

• vibration bursts on the intensity of the force exerted by the robotic finger (condition V t ), 

• continuous vibrations proportional to the intensity of the force exerted by the robotic finger (condition 

V c ), 

• no haptic feedback at all (condition N). 

In condition V m 6, the vibrotactile ring provided a 200 ms-long vibration on making and breaking contact 
with the cylinder. Moreover, it also provided a 200 ms-long vibration when the force exerted by the 
robotic finger was close to the maximum force that actuators could provide at the fingertip (i.e., 5 N). 
The amplitude and frequency of these vibrations were set to 0.30 g and 100 Hz, respectively, so to be 
easy to recognize (input voltage ^ = 0.7 V, see Sec. 5.2). In condition Vt, the vibrotactile ring provided 
200 ms-long vibrations on making and breaking contact with the cylinder and when the force sensed by 
the robotic finger was equal to 2 N and 4 N (we considered the maximum force sensed among the three 
sensors). On the making and breaking contact, the amplitude and frequency of the vibrations were set to 
0.30 g and 100 Hz, respectively, as in condition V m 6 (input voltage V{ — 0.7 V). On the other hand, when 
the force sensed by the robotic finger was 2 N and 3 N, the vibrotactile motor was provided with inputs 
Vi of 0.9 V (amp. 0.43 g, freq. 124 Hz) and 1.7 V (amp. 0.94 g, freq. 222 Hz), respectively. Amplitude 
values and force thresholds were chosen to be easy to distinguish (see Sec. 5.2) and fit the vibrotactile 
motor specifications (see Fig. 5.4). 

In condition V c , the vibrotactile ring provided continuous vibrotactile feedback proportional to the 
intensity of the force exerted by the robotic finger. The commanded input voltage proportional to the 
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Figure 5.8: Pick-and-place experiment. Completion time, mean exerted force, and perceived effectiveness for 
conditions providing vibration bursts on making and breaking contact and when close to the actuators’ force limit 
(V m b), vibration bursts on the intensity of the force exerted (Vt), continuous vibrations proportional to the intensity of 
the force exerted (V c ), and no haptic feedback (N). Mean and Standard Error of the Mean (SEM) are plotted. 


mean force sensed on the robotic finger, was evaluated as 

_ {fe,max + 0.3) 

Vl ~ 2.5 f 

where f e ,max is the maximum force registered among the three sensors on the robotic finger. The 
relationship between input voltage Vi and the amplitude and frequency of the vibration can be found in 
Fig. 5.4. For example, when the sensors register an average force of 2 N, the vibrotactile ring provides a 
vibration of amplitude 0.43 g and frequency 124 Hz (as in condition V t ). No vibration was provided when 
the robotic finger was not in contact with the object. In condition N, no haptic feedback was provided. 
Completion time and mean exerted forces provided a measure of performance. A low value of these metrics 
denotes the best performance. The time started to be recorded when the semi-autonomous grasping phase 
was completed and the user lifted the object, and it stops when the object was placed on its final position. 
Fig. 5.8a shows the average task completion time. All the data passed the Shapiro-Wilk normality test and 
the Mauchly’s Test of Sphericity. A repeated-measure ANOVA showed a statistically significant difference 
between the means of the four feedback conditions (F(3,27) = 16.597, p < 0.001, a = 0.05). Post hoc 
analysis with Bonferroni adjustments revealed a statistically significant difference between condition N 
and all the others (N vs. \ m b, p = 0.002; N vs. V*, p = 0.027; N vs. V c , p = 0.014). 

Fig. 5.8b shows the average exerted force, evaluated as the mean over time of f e ,max • All the data 
passed the Shapiro-Wilk normality test. Mauchly’s Test of Sphericity indicated that the assumption of 
sphericity had been violated (x 2 (2) = 17.008, p < 0.001). A repeated-measure ANOVA with Greenhouse- 
Geisser correction showed a statistically significant difference between the means of the four feedback 
conditions (F(1.482,13.340) = 12.015, p = 0.002, a = 0.05). Post hoc analysis with Bonferroni adjustments 
revealed again a statistically significant difference between condition N and all the others (N vs. V m &, 
p = 0.032; N vs. Vt, p = 0.025; N vs. V c , p = 0.015). In addition to the quantitative evaluation 
reported above, we also measured users’ experience. Immediately after the experiment, subjects were 
asked to report the effectiveness of each feedback condition in completing the given task using bipolar 
Likert-type seven-point scales. Fig. 5.8c shows the perceived effectiveness of the four feedback conditions. 
A Friedman test showed a statistically significant difference between the means of the four feedback 
conditions (x 2 (3) = 27.903, p < 0.001). The Friedman test is the non-parametric equivalent of the more 
popular repeated measures ANOVA. The latter is not appropriate here since the dependent variable was 
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measured at the ordinal level. Post hoc analysis with Bonferroni adjustments revealed a statistically 
significant difference between conditions N and \ m b (p < 0.001), N and V c (p = 0.001), and V t and 
V mb (p = 0.008). Moreover, although condition \ t was not found significantly different from condition 
V c , comparison between them was very close to significance (p = 0.072). Finally, subjects were asked to 
choose the condition they preferred the most. Condition \ m b was preferred by six subjects and condition 
V c was preferred by four subjects. 

Conclusion 

The first part of this chapter presented the integration of the wearable robotic extra finger with a ring able 
to provide vibrotactile haptic feedback. We introduced also a new solution for the grasping phase based on 
a wearable switch embedded in the ring and a closing policy that let the robotic finger adapt to the object’s 
shape. In order to evaluate the effectiveness of our extra finger device and the usefulness of vibrotactile 
haptic feedback, we carried out a pick-and-place experiment. Ten subjects were asked to grasp a cylinder, 
lift it, and move it 45 cm right, being as fast as possible. Haptic feedback significantly improved the 
performance of the task in terms of completion time, exerted force, and perceived effectiveness. Moreover, 
all subjects preferred conditions employing haptic feedback. Within the conditions employing haptic 
feedback, no statistical difference was found in terms of completion time and force exerted. However, 
conditions \ m b and V c were perceived as more effective than \ t . This may be due either to a saturation 
effect on the skin receptors or to the fact that the very rich information provided in condition \ t can be 
difficult to be understood by the user. 


5.3 The hRing as a wearable haptic interface for supernumerary 
robotic fingers 

The wearable electronics business has powered over $14 billion in 2014 and it is estimated to power over 
$70 billion by 2024. However, the propsed vibrotactile interface and commercially-available wearable 
devices still provide very limited haptic feedback, mainly focusing on vibrotactile sensations. Towards a 
more realistic feeling, the second part of the chpater proposes a novel wearable cutaneous device for the 
proximal finger phalanx, called “hRing”. It consists of a vibro motor and two servo motors that move a 
belt placed in contact with the user’s finger skin. When the motors spin in opposite directions, the belt 
presses into the user’s finger, while when the motors spin in the same direction, the belt applies a shear 
force to the skin. 

Researchers have recently proposed several wearable haptic devices able to provide rich cutaneous 
sensations at the fingertips [115, 122], enabling a compelling interaction with virtual and remote objects. 
However, although quite effective, placing such haptic-enabled wearable devices at the fingertips may 
significantly affect the quality of the fingertip tracking, especially if done using unobtrusive solutions such 
as the Microsoft Kinect Sensor or the Leap Motion Controller. Moreover, wearable cutaneous devices 
prevents the users from using their fingertips to interact with real objects(e.g., in the case of augmented 
reality scenarios). Towards a realistic and unobtrusive feeling of interacting with real and virtual objects, 
we propose a novel wearable cutaneous device for the proximal finger phalanx, called “hRing”, shown in 
Fig. 5.9a. 

A preliminary version of this wearable device has been presented in [111]. With respect to the 
version proposed in [111], the new hRing presented in this work offers enhanced mobility of the finger 
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(a) hRing 


(b) Soft Robotic Finger 


Figure 5.9: The hRing and the soft robotic finger (SRF). 


phalanx, ambidexterity, a vibrotactile motor, and a lighter body structure. Pacchierotti et al. [Ill] used 
the earlier version of this interface to interact with objects in a virtual environment and results show 
that providing cutaneous feedback through the proposed device improved the performance and perceived 
effectiveness of the considered virtual pick-and-place task of 20% and 47% with respect to not providing 
any force feedback, respectively. In this work, we propose the hRing as interface to interact with a novel 
underactuated soft supernumerary robotic finger (SRF), as shown in Fig. 5.9. 

Wearability is the key concept in the design of the proposed hRing cutaneous device. Besides 
wearability, other essential features are comfort, effectiveness, and ease of use. For ah the reasons 
mentioned above, the hRing device has been designed to be worn on the proximal part of the index finger. 

Description 

The hRing is shown in Fig. 5.9a. It is composed of a static part, that houses two servo motors and two 
pulleys, and a fabric belt, that applies the requested stimuli to the finger. A strap band is used to secure 
the device on the finger proximal phalanx. We used two PWM-controlled HS-40 servomotors (HiTech, 
Republic of Korea). The device weights 38 g for 30x43 x 25 mm dimensions. 

Haptic feedback 

The working principle of the device is depicted in Fig. 5.11. Similarly to the principle proposed by 
Minamizawa et al. [122], when the two motors rotate in opposite directions, the belt is pulled up, providing 
a force normal to the finger (left side of Fig. 5.11). On the other hand, when motors spin in the same 
direction, the belt applies a shear force to the finger (right side of Fig. 5.11). Of course, these two 
movements can be combined together to provide at the same time shear and normal stimuli. 

Differential thresholds 

To understand how to correctly modulate the cutaneous stimuli provided, we carried out two preliminary 
experiments evaluating the differential thresholds for normal and shear stimuli. The differential threshold 
can be defined as “the smallest amount of stimulus change necessary to achieve some criterion level of 
performance in a discrimination task” [119]. It gives us information about how different two displacements 
provided with our device need to be in order to be perceived as different by a human user. This threshold 
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1 2 3 

reference stimulus (mm) 

(a) JND for normal stimuli 


0.9 1.35 

reference stimulus (mm) 

(b) JND for shear stimuli 


Figure 5.10: Differential threshold. Mean values are plotted as empty black circles, thresholds for each subject are 
plotted as blue dots. 


is often referred to as just-noticeable difference or JND. The differential threshold of a perceptual stimulus 
reflects also the fact that people are usually more sensitive to changes in weak stimuli than they are 
to similar changes in stronger or more intense stimuli. The German physician Ernst Heinrich Weber 
proposed the simple proportional law JND = kl , suggesting that the differential threshold increases with 
increasing the stimulus intensity /. Constant k is thus referred to as “Weber’s fraction”. For example, 
Schorr et al. [123] measured the ability of users to discriminate environment stiffness using varying levels 
of skin stretch at the finger pad. Results showed a mean Weber fractions of 0.168. Similarly, Guinan et 
al. [124] found a mean Weber fraction of 0.2 for their skin stretch sliding plate tactile device. 

Seven participants took part in the experiments, including one woman and six men. Four of them had 
previous experience with haptic interfaces. None of the participants reported any deficiencies in their 
visual or haptic perception abilities, and all of them were right-hand dominant. Subjects were required to 
wear the device on their right index proximal phalanx. To avoid providing any additional cue, subjects 
were blindfolded and wore noise-canceling headphones. 

Normal stimuli 

We evaluated the differential threshold for normal stimuli using the simple up-down method [120]. We 
used a step-size for the servo motors of a = 1°, that corresponded to a normal displacement of the belt of 
p = 0.09 mm. We considered the task completed when six reversals occurred. Subjects were required to 
wear the cutaneous device and tell the experimenter when the two stimuli provided felt different. We tested 
the JND at three standard stimuli: 1 mm, 2 mm, 3 mm, and 4 mm of displacement into the finger pad. Each 
participant performed eight trials of the simple up-down procedure, with two repetitions for each standard 
stimulus considered. Fig. 5.10a shows the differential thresholds registered for each reference stimulus. 
For the reference stimuli of 1 mm, 2 mm, 3 mm, and 4 mm, the average JNDs are 0.07 mm, 0.12 mm, 
0.16 mm, and 0.19 mm. respectively. Thus, the Weber fractions are 0.07, 0.06, 0.05, 0.05, respectively, 
following Weber’s Faw. 

We evaluated the differential threshold for shear stimuli using the simple up-down method again [120]. 
We used a step-size for the servo motors of a = 1°, that corresponds to a lateral movement of the belt 
on the finger pad of 0.09 mm. We considered the task completed when six reversals occurred. Subjects 
were required to wear the cutaneous device and tell the experimenter when the two stretches provided 
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Motors spin in opposite 
directions generating 
normal forces 


Motors spin in the same 
direction generating 
shear forces 



Figure 5.11: Device actuation principle. When the motors spin in opposite directions, the belt presses into the user’s 
finger (left), while when the motors spin in the same direction, the belt applies a shear force to the skin (right). 

felt different. We tested the JND at three standard stimuli: 0.45 mm, 0.90 mm, 1.35 mm, and 1.80 mm 
of stretch on the finger pad. The normal displacement into the skin was fixed to 6 mm. Each participant 
performed eight trials of the simple up-down procedure, with two repetitions for each standard stimulus 
considered. Fig. 5.10b shows the differential thresholds registered for each reference stimulus. For the 
reference stimuli of 0.45 mm, 0.90 mm, 1.35 mm, and 1.8, the average JNDs are 0.08 mm, 0.15 mm, 
0.17 mm, and 0.26 mm, respectively. Thus, the Weber fractions are 0.18, 0.16, 0.13, 0.15, respectively, 
following Weber’s Faw. No slippage between the belt and the skin took place during the trials. We 
integrated the ’’hring” with the soft robotic finger shown in 5.9. Although the hRing can apply both normal 
and shear forces, in this work, we used it to only apply forces normal to the finger skin, similarly to [125]. 
This is mainly due to the fact that we have not added any multi-DoF force sensor on the robotic finger, 
with the objective of improving its wearability and portability. As detailed below, we estimate the contact 
force solely from the load of the finger’s motor. Nonetheless, as also mentioned in Sec. 7.5, in the future, 
we plan to add an ATI 6-DoF force/torque sensor on the distal module of the supernumerary finger, to be 
able to accurately measure the forces exerted by the finger on the environment. 

The relationship between the belt displacement and the force applied to the human finger proximal 
phalanx, fh , is 



(5.1) 


where Ad G M is the displacement of the belt toward the skin since it first made contact with the fingertip, 
and K E M is the finger phalanx stiffness value [126, 127]. 

The force exerted by the supernumerary finger on the environment is evaluated by considering the load 
of the motor r m , 



(5.2) 


where r m E [0, t^m] Nm, r m? M = 2.5 Nm is the maximum torque the motor can provide, and 
fh,M = 9.4 N is the maximum force the hRing can apply on the finger skin. fh,M was measured 
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positioning an ATI Nano force/torque sensor between the belt and the rigid structure of the hring and 
applying the maximum opposite rotation of both servo motors, i.e., the maximum squeezing force. 


5.4 Control 

Pressing the blue (proximal) button on the external side of the hRing (see Fig. 5.9) initiates the flexing 
procedure of the robotic finger. The finger will then close until a contact with an object is detected. As soon 
as the contact happens, the robotic finger stops its flexion and the hRing generates a short vibration burst 
to notify the subject. If the subject presses the blue button again, the finger increases the grasping force 
on the object. During this process, the hRing belt squeezes the user’s finger proportionally to the grasp 
force applied by the robotic finger on the environment. If the grasping force exerted by the robotic finger 
reaches the maximum force applicable by the motor, a double vibration burst alerts the user. When the 
patient is satisfied with the grasping configuration, he or she can proceed with the task. Finally, pressing 
the yellow (distal) button on the hRing will initiate the opening procedure of the robotic finger. 

5.5 Experiments 

In order to demonstrate the effectiveness of our system, we carried out two experiments, enrolling sixteen 
healthy subjects and two post-stroke patients. 

Experiment #1: pick and place with healthy subjects 

Subjects 

Sixteen healthy participants (12 males, 4 females, age range 21 - 32) took part to the experiment, all 
of whom were right-handed. Nine of them had previous experience with haptic interfaces. None of the 
participants reported any deficiencies in their perception abilities and they were all naive as to the purpose 
of the study. 

Setup 

The experimental setup is shown in Fig. 5.12. It is composed of our supernumerary finger, worn on the 
right forearm, and the hRing cutaneous interface, worn on the proximal phalanx of the left index finger. As 
for this experiment we enrolled only healthy subjects, we asked them to mimic the post-stroke hemiparesis 
of their right hand by keeping the hand closed in a fist. Subjects were then asked to stay in front of a table 
where 5 different objects were placed. Details on the objects are reported in Table 5.1. The target locations 
for the objects were marked on the table. Subjects had to pick, lift, and place all the objects correctly, 
being as fast as possible and using only their right (impaired) arm. Subjects could move the objects in 
any order they prefer. To prevent subjects from dragging the objects, we placed an obstacle between the 
starting and target objects’ locations. 

Methods 

We carried out the pick and place task in three different experimental conditions: no grasping compensa¬ 
tion (N), grasping compensation using the supernumerary finger (S), grasping compensation using the 
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Table 5.1: Details on the objects used for the experiment 


Object 

Weight 

(g) 

Dimensions 

(cm) 

Dice 

10 

7x7x7 

Glass 

3 

7x7x8 

Cube #1 

8 

2.5x2.5x2.5 

Cube #2 

8 

2.5x2.5x2.5 

Sauce can 

348 

6.5x6.5x 10 

Toy #1 

160 

7.5x7.5x10 

Toy #2 

107 

6x6x9.5 



starting area 

Figure 5.12: Experiment #1: pick and place. Subjects were asked to pick, lift, and place all the objects correctly, being 
as fast as possible and using only their right (impaired) arm. The hRing was used to open/close the supernumerary 
finger and to receive haptic feedback. 


supernumerary finger and the hRing haptic interface (SH). Subjects performed the experiment two times 
per condition, ending up with 6 randomized repetitions of task per subjects. 

When no grasping compensation (N) was considered, subjects did not wear the supernumerary finger 
and the hRing interface. 
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Table 5.2: Experiment#!: success rate. 


ConditionSuccess rate 

Objects placed at the time limit 
(mean d= standard dev.) 



3.67 ± 0.49 

N 

0% 

(no one picked up the small 
cubes) 

S 

100% 

5 

SH 

100% 

5 


When grasping compensation using the supernumerary finger (S) was considered, subjects were asked 
to wear the supernumerary finger on their right forearm and the hRing on the proximal phalanx of their left 
index fingers. The hRing was only used to control the opening/closing motion of the supernumerary finger, 
as described in Sec. 6.3, and provided no haptic feedback. 

When grasping compensation using the supernumerary finger and the hRing haptic interface (SH) was 
considered, subjects were asked again to wear the supernumerary finger on their right forearm and the 
hRing on the proximal phalanx of their left index fingers. This time the hRing was used to both control 
the opening/closing motion of the supernumerary finger, as described in Sec. 6.3, and to provide haptic 
feedback about the forces exerted by the supernumerary finger to the environment and about the status of 
the grasping procedure, as described in Sec. 6.3. 

In all these conditions, subjects were asked to keep their right hand closed in a fist to mimic the 
hemiparesis of the hand. 

Results 

As a measure of performance, we evaluated (1) the success rate of the pick and place task, (2) the 
completion time, (3) the force applied by the supernumerary finger to the object being grasped, and (4) 
the perceived effectiveness of the three conditions. Table 5.2 shows the success rate for the considered 
task. The task was considered successful if all the objects were correctly placed within a time limit of 3 
minutes. No one was able to pick up the two small cubes without the supernumerary finger (condition 
N). Due to this result, for the next two metrics, we only considered conditions using the supernumerary 
finger (S and SH). Fig. 5.13a shows the completion time. The collected data passed the Shapiro-Wilk 
normality test. We ran a paired-samples t-test and the condition S elicited a statistically significant increase 
in completion time compared to condition SH, £(15) = 2.153, p = 0.048. Fig. 5.13b shows the mean load 
exerted by the supernumerary finger on the environment, registered by the servo motors, considering only 
instants when the load was more than zero. Fig. 5.13c shows the same mean load split object by object 
(objects are listed in Tab. 5.1). We ran a two-way repeated-measures ANOVA. Feedback conditions (S 
vs. SH) and objects were treated as within-subject factors. The data passed the Shapiro-Wilk normality 
test. Mauchly’s Test of sphericity indicated that the assumption of sphericity had not been violated for 
the objects factor (x 2 (9) = 10.066, p = 0.349). Sphericity was assumed for the other factor, as it has 
only two levels. The two-way repeated-measure ANOVA did not reveal a statistically significant two- 
way interaction between feedback conditions and objects (F 4j60 = 1.914, p = 0.113). The main effect 
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(a) Completion time (s). 




(c) Motor load per object (Nm). 



(d) Perceived effectiveness. 


Figure 5.13: Experiment #1: pick and place. Overall mean and 95% confidence interval of (a) completion time and (b) 
motor load; (c) means of motor load split by object; (d) perceived effectiveness of the feedback conditions (the rating 
given by the subject could be in the range 1 — 10, the higher values, the better performance). 


showed a statistically significant difference in motor load between conditions (Fi ? iq = 25.326, p < 0.001) 
and objects (F 4j60 = 93.587, p < 0.001). According to the pairwise comparison, all objects lead to 
significantly different loads except dice vs. glass. Moreover, we ran a Pearson product-moment correlation 
test to study the relationship between the motor load exerted to lift each object and its weight. Regardless 
of the feedback condition considered, we found a strong positive correlation between these two variables: 
r(3) = 0.969, p = 0.007 and r(3) = 0.964, p = 0.008 for the conditions S and SH, respectively. 

In addition to the quantitative evaluation reported above, we also measured users’ experience. At the 
end of the experiment, subjects were asked to rate, on a slider going from 0 to 10, the effectiveness of 
each feedback condition in completing the given task. Figure 5.13d shows the perceived effectiveness for 
the three feedback conditions. A Friedman test showed a statistically significant difference between the 
means of the three feedback conditions (x 2 (2) = 27.763, p < 0.001). Post hoc analysis with Bonferroni 
adjustments revealed a statistically significant difference between N vs. S (p = 0.008) and N vs. SH 
(p < 0 . 001 ). 

Experiment #2: ADL tasks with post-stroke patients 

Two chronic stroke patients (both males, age 35 and 56) took part to our experimental evaluation. The 
two subjects were required to wear the robotic finger on their paretic hand and the hRing on the healthy 
hand index finger (see Fig. 5.14). The proposed compensatory tool can be used by patients showing a 
residual mobility of the arm. For being included in this experimental evaluation, patients had to score < 2 
when their motor functions were tested with the National Institute of Health Stroke Scale (NIHSS), item 
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(a) Opening the jar of jam. (b) Cutting the piece of bread. 


Figure 5.14: One chronic stroke patient performing ADL bi-manual tasks 

5, “paretic arm”. Moreover, the patients had to show the following characteristics: normal consciousness 
(NIHSS, item la, lb, lc = 0), absence of conjugate eyes deviation (NIHSS, item 2 = 0), absence of 
complete hemianopia (NIHSS, item 3 < 1), absence of ataxia (NIHSS, item 7 = 0), absence of completely 
sensory loss (NIHSS, item 8 < 1), absence of aphasia (NIHSS, item 9 = 0), absence of profound extinction 
and inattention (NIHSS, item 11 < 1). 

The patients used the soft finger for bimanual tasks typical of Activities of Daily Living (ADL), such 
as opening ajar of jam, breaking a piece of bread, and opening a can of beans. In all the tasks, the patients 
used the robotic finger and the paretic limb to hold the object, while the healthy hand was used to perform 
the manipulation and to interact with the hRing. For example, the patient can hold the bread with the help 
of supernumerary robotic finger and non-functional arm, while using the healthy hand to break it (see 
Fig. 5.14b). As described in Sec. 6.3, the hRing interface was used to both control the flexion/extension 
motion of the robotic finger and to provide the patient with haptic feedback about the forces exerted by the 
robotic finger on the environment and the status of the grasping procedure. 

Both patients found the soft robotic finger useful in the considered ADL tasks. Moreover, they found the 
hRing intuitive to use and unobtrusive. Finally, they reported haptic feedback to be a valuable information 
to estimate the quality of the grasp. Both patients would like to be able to use it at home. 


5.6 Discussion, Conclusion, and future work 

The second part of this chapter presented the integration of novel soft supernumerary robotic finger with 
a wearable skin stretch cutaneous interface, called hRing. The supernumerary finger aims at restoring 
the grasping capabilities of post-stroke patients with a paretic hand. The hRing enables patients to easily 
control the motion of the robotic finger while providing them with haptic feedback about the status of the 
grasping action. 

To demonstrate the effectiveness of our system, we carried out two experiments, enrolling sixteen 
healthy subjects and two post-stroke patients in pick-and-place and ADL tasks, respectively. Healthy 
subjects were asked to mimic a paresis on their right hand by closing it in a fist. Results with the healthy 
subjects showed that the supernumerary finger can significantly help to restore the grasping capabilities 
of paretic hands. Indeed, no subject was able to complete the pick-and-place task without using the 
supernumerary finger. Moreover, results also show that providing cutaneous feedback through the hRing 
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significantly improve the performance of the considered pick-and-place task in terms of force applied 
on the environment and perceived effectiveness. It is worth to point out that the heavier the object, the 
larger the improvement of performance when using the haptic feedback. Finally, the two chronic stroke 
patients found the system very useful for ADL tasks, the hRing easy to use, and the haptic feedback very 
informative. 



Chapter 6 

Wearable EMG interfaces for motion control of supernu¬ 
merary robotic fingers 


This chapter presents two kinds of electromyographic (EMG) control interfaces for supernumerary robotic 
fingers. In particular, frontalis muscle cap and arm EMG interface. The former is more suitable for 
underactuated soft fingers while the latter is developed to control the motion and compliance of fully 
actuated robotic finger. 

In frontalis muscle cap the electrodes and acquisition boards are embedded in a cap which allows the 
user to control the device motion through wireless communication by contracting the frontalis muscle. We 
used the cap interface with soft sixth finger to perform qualitative experiments involving six chronic stroke 
patients. Results show that the proposed system significantly improves the performance of the considered 
tests and the autonomy in ADL. 

The arm EMG interface composed of a commercial EMG armband for gesture recognition to be 
associated with the motion control and to regulate the compliance of the robotic device. On fully actuated 
robotic finger side, we proposed a control approach to regulate the compliance of the device through servo 
actuators and presented the updated version of the device where the adduction/abduction motion is realized 
through ball bearing and spur gears mechanism. We have validated the proposed interface with two sets of 
experiments related to compensation and augmentation. In the first set of experiments, different bi-manual 
tasks have been performed with the help of the robotic device and simulating a paretic hand since this novel 
wearable system can be used to compensate the missing grasping abilities in chronic stroke patients. In the 
second set, the robotic extra finger is used to enlarge the workspace and manipulation capability of healthy 
hands. In both sets, the same EMG control interface has been used. The obtained results demonstrate that 
the proposed control interface is intuitive and can successfully be used, not only to control the motion of a 
supernumerary robotic finger, but also to regulate its compliance. The proposed approach can be exploited 
also for the control of different wearable devices that has to actively cooperate with the human limbs. 

This Chapter is an extended and revised version of the work published in [2, 128] 


6.1 Introduction 

One of the major challenge in augmenting/compensating human capabilities through robotic extra limbs 
concerns the development of a suitable control interfaces for the integration of the device motion with 
that of the human. [15] presented a control algorithm enabling a human hand augmented with two robotic 
fingers to share the task load together and adapt to diverse task conditions. Postural synergies were found 
for the seven-fingered hand comprised of two robotic fingers and five human fingers through the analysis 
of measured data from grasping experiments. In [16], a mapping algorithm able to transfer to an arbitrary 
number of robotic extra-fingers the motion of the human hand has been presented. The mapping algorithm 
was based on the definition of a virtual object obtained as a function of a set of reference points placed 
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on the augmented hand (human hand and robotic fingers). The mapping algorithm allowed to move the 
extra-fingers according to the human hand motions without requiring explicit command by the user. Both 
the approaches used an instrumented glove to track the human hand presenting some limitations which 
affected their practical application. Patients with a paretic hand cannot properly control finger motions, thus 
a dataglove interface cannot be used. The estimation of the human hand posture and fingers motion implies 
a reliable and computationally expensive hand tracking. Moreover, datagloves can be only used for position 
control of the robotic device without having any control on force or stiffness regulation. As a preliminary 
solution to the above mentioned issues, we implemented a trigger based control approach [19, 29]. The 
trigger signal was activated by a wearable switch placed on a ring. A single switch activation regulated the 
stop/motion of the finger along a predefined flexion trajectory, while a double activation switched from 
flexion to extension and viceversa. Although the ring based control approach resulted simple and intuitive, 
this control interface involved human hand thumb - on the same hand for healthy subjects [19] and on the 
controlateral hand for patients [29] - to control the motion of robotic finger thus limiting the use of thumb 
in completion of tasks. Moreover, it offers few user control inputs to control the motion of the robotic 
finger and force control is not straightforward. In order to overcome these limitations, in particular to 
obtain multiple user control inputs to control the motion of extra-robotic finger as well as to regulate its 
compliance, we started exploring EMG signals as possible control interface. 

The EMG signal is a biomedical signal that measures electrical currents generated in a muscle during 
its contraction representing neuromuscular activities. The EMG signal is controlled by the nervous system 
and is dependent on the anatomical and physiological properties of muscles. The main reason for the 
interest in EMG signal analysis is in clinical and biomedical applications as well as to study the human 
interactions with the physical world like in case of human-robot interaction. EMG measures the electrical 
potential between a ground electrode and a sensor electrode. It is possible to measure signals either within 
the muscle (invasive EMG) or on the skin above a muscle (surface EMG) [129]. The expressiveness of 
the latter is comparatively limited, but in return, the approach is more easily applicable and does not need 
special preparation of the skin nor special medical training of the operator. EMG signal acquires noise 
while traveling through different tissues. Moreover, the EMG detector, particularly if it is at the surface of 
the skin, collects signals from different motor units at a time which may generate interaction of different 
signals. Detection of EMG signals with powerful and advance methodologies is becoming a very important 
requirement in biomedical engineering. The control of the finger flexion/extension through an EMG signal 
captured by surface electrodes placed on the user’s frontalis muscle was presented in [30]. The EMG 
interface was able to detect if the frontalis muscle of the user was voluntary contracted. The frontalis 
muscle is always spared in case of stroke due to its bilateral representation in the brain cortex. This makes 
the frontalis muscle a suitable candidate for the control of an intrinsically compliant underactuated extra 
finger for grasp compensation as that proposed in [2]. However, when more dexterous robotic devices are 
considered and when more sophisticated manipulation motions are required, the use of a single muscle is 
not sufficient to control both motion and force exerted. For that reason, this chapter also presents a novel 
EMG based control interface which not only can control different trajectories of multi degree of freedom 
finger but also can regulate its compliance. 



6.2. The frontalis muscle cap: a wireless EMG system for the control of underactuated soft supernumerary 



Figure 6.1: The frontalis muscle cap interface. The EMG electrodes are placed inside the cap at front side to be 
positioned on the patient’s forehead. The acquisition board is placed in a box on the back of the cap. 


6.2 The frontalis muscle cap: a wireless EMG system for the control 
of underactuated soft supernumerary robotic finger 

The control interface for patient oriented devices must be intuitive and simple, since chronic patients may 
also be affected by some cognitive deficits, possibly limiting their compliance during a demanding learning 
phase. We propose the frontalis muscle cap : an Electromyography (EMG) based wireless interface which 
maintains the principle of simplicity of a switch without interrupting the patient activities and without the 
involvement of healthy hand during task execution. The frontalis muscle cap is a wearable wireless EMG 
interface where electrodes, acquisition and signal conditioning boards are embedded in a cap, Figure 6.1. 
A preliminary version of the control interface has been presented in [2]. This solution allows the patients to 
autonomously wear the interface using only their healthy hand. Several EMG interfaces have been already 
successfully adopted for the control of prosthesis [130] and exoskeletons [44]. The electrodes are usually 
placed either in the muscles coupled with the robot (exoskeleton) or in muscles where amputees still have 
the phantom of functions and hence they are able to generate a repeatable EMG pattern corresponding to 
each of the functions (prosthesis). For chronic patients it is generally difficult to generate repeatable EMG 
patterns in their paretic upper limb due to the weakness in muscle contraction control. For this reason, we 
coupled the flexion/extension motion of the robotic device with the contraction of the frontalis muscle. 
This muscle is always spared in case of a motor stroke either of the left or of the right hemisphere due to 
its bilateral cortical representation. The user can contract this muscle by moving the eyebrows upwards. 
The electrodes in the frontalis muscle cap capture the arising EMG signal that is acquired through an EMG 
signal conditioning circuit and processed by a control algorithm as explained in the following. 

EMG measures the electrical potential between a ground electrode and a sensor electrode. It is possible 
to measure signals either within the muscle (invasive EMG) or on the skin above a muscle (surface 
EMG) [129]. We used surface EMG electrodes to measure electrical signals associated with the patient’s 
frontalis muscle. In particular, on the inner side of the frontalis muscle cap , we installed non-gelled 
reusable silver/silver-chloride electrodes, as they present the lowest noise interface and are recommended 
for biopotentials recording [131]. We designed an EMG signal acquisition board taking into consideration 
the requirements associated with bandwidth, dynamic range and physiological principles. The typical 
EMG waveform is characterized with a spectral content between 10 to 250 Hz with amplitude up to 5 mV, 
depending on the particular muscle [132]. 

Figure 6.2 shows the block diagram of the implemented EMG circuit board. Three electrodes are 
interfaced to the board: two of them (V/at+ and Vin-) are connected to the inputs of an instrumentation 
amplifier (In-Amp), while the third one called “ground electrode” is connected to a mid-supply reference 
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Table 6.1: Specifications of EMG Acquisition Board 


EMG acquisition box dimensions 

35 x 31 x 45 mm 3 

EMG acquisition box weight 

46 g 

Principle 

Differential voltage 

Number of electrodes 

3 

Bandwidth 

10 - 400 Hz 

Gain 

1000 

Input Impedance 

ioo Gn 

CMRR 

110 dB 

Operating voltage 

Vcc = 3.3 V 


voltage ( V ss = V cc /2). This configuration improves the quality of EMG signal acquisition as it increases the 
common mode rejection ratio (CMRR). The first stage of the EMG board is an In-Amp with an additional 
stage of AC-coupling. This configuration allows a precise control of DC levels rejecting undesired DC 
offset voltage introduced by electrode-skin interface. The DC component is subtracted by feeding the 
output signal back to the reference input of the In-Amp, by an integrator feedback network, which results 
in a first-order highpass response. The second stage of the EMG board is a 4 th order lowpass Butterworth 
filter. An active topology (a Sallen-Key circuit implementation - 4 th order low-pass filter cascading two 
stages of 2 nd order) was chosen to get a better performance and less complexity than a passive one. The 
specifications of the EMG acquisition board are summarized in Table 6.6. 

The acquired EMG signal is sampled at 1 kHz (double EMG band) to avoid aliasing and a wireless 
communication is realized by a pair of Xbee modules (Series 1). The transmitter is embedded in the 
frontalis muscle cap while the receiver is placed on the actuator controller unit. The reference value of 
received EMG were normalized using maximum voluntary contraction (MVC) technique [133]. This 
solution avoids the problems related to the high influence of detection condition on EMG signal amplitude. 
In fact, amplitude can greatly vary between electrode sites, subjects and even day to day measures of 
the same muscle site. We implemented an auto-tuning procedure based on the MVC in order to better 
match the user-dependent nature of the EMG signal. This is the major improvement with respect to the 
frontalis muscle cap version proposed in [2] where the sensitivity of the system was manually set through 
a potentiometer. The implemented MVC routine consists of a 3 s time window in which the users slowly 


1 st stage 2 nd stage 



Figure 6.2: Block diagram of the EMG circuit board. Vin+ and Vin- are the “detecting electrodes” while V ss = 
Vcc/2 is the “ground electrode”. REF is the reference voltage terminal of the In-Amp. 
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Actuator Control Unit 




Visual Feedback 
ControJ .Board 



Figure 6.3: The block diagram of EMG wireless and push-button interface with actuator control unit. LEDs associated 
to the motion of device are mounted on visual feedback control board. 



Figure 6.4: Top: raw EMG signal. Bottom: example of two activations in a time window of 1 s. CS (blue) is the 
processed EMG signal after the operations of rectification, normalization and filtering; T (green) is the threshold and 
ST (red) is the resulting trigger. 


start increasing the contraction of the forehead muscle to reach their maximum effort. The MVC value 
itself is not calculated as a single peak data point to avoid high variability. In order to obtain a more stable 
reference value, we have implemented an algorithm using a sliding window technique of 500 ms duration 
to compute the mean amplitude of the highest signal portion acquired during the 3 s time window. 

The motion of compensatory robotic device is then controlled by using a finite state machine based on 
a trigger signal. The trigger signal is obtained by using a single-threshold value defined as the 50% of the 
MVC, a level that was repeatable and sustainable for the subject without producing undue fatigue during 
the use of the device. We set a minimum time (20 ms) in which the EMG signal has to constantly stay over 
the threshold to generate the trigger signal to prevent false activation due to glitches or to spontaneous 
spikes. Figure 6.12 shows the raw EMG signal and the signal after the conditioning operations, i.e., 
rectification, normalization and filtering. The red signal shown in bottom graph of Figure 6.12 is the 
resultant trigger signal which is generated if the EMG signal exceeds the threshold. 

We implemented a trigger signal based finite state machine (FSM) [134] to control the motion of 
the devices. The outputs of the FSM are predefined commands based on sequences of input signals. 
We consider a finite number of states, transition between those states, and commands. States represent 
predefined motion commands for the robotic device and transition actions are associated with contractions 
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e 5 



Figure 6.5: The proposed finite state machine (fsm) for the motion control of the robotic devices. Events e\ and e 2 
are generated by the user, while is a software defined event. Event occurs once the object is grasped. Event e 5 
activates on switching between two proposed control interfaces (frontalis muscle cap or push-button). 


of the frontalis muscle. The patients control the motion/stop of the finger with a single muscle contraction 
(event ef). Once the finger is stopped, two contractions (event ef) in a time window of 1 s switch the 
direction of motion from flexion to extension and viceversa. The time window length was experimentally 
selected after the repeated trials with patients and resulted to be in-line with the one proposed in [135]. A 
software defined trigger (event ef) stops the actuator’s motion once the object is considered as grasped, 
to avoid torque overloading situation. The grasp confirmation is detected by continuous monitoring the 
actuator’s shaft position and the exerted torque. During the grasping procedure, if the position does not 
change in a time window of 2 s and a predefined torque threshold is reached, the object is considered as 
grasped. The proposed FSM is reported in Figure 6.14. 

A LED board (see Figure 6.3) is used to provide a visual feedback of the selected commands. In 
particular, a yellow LED blinks on each trigger signal. When flexion is selected an orange LED is turn on, 
while a green LED shows the extension. Finally a red LED is turn on when the device is stopped. At this 
stage, the LED associated to the previous selected state is also turned on to remind the user about the last 
stage of the device. 

To provide an additional interface for the user, as well as a recovery mode for possible problem in the 
frontalis muscle cap communication, we added a push-button on the LED board as further possible control. 
Both interfaces use the same trigger-based logical scheme to control the motion of robotic devices. The 
switching between two control interfaces can be achieved at any moment by a toggle switch installed on the 
controller board. If the frontalis muscle cap is selected, the procedure of maximum voluntary contraction 
(MVC) is first executed. Once it is completed, the program passes from calibration to test mode. If the 
push-button is selected, the control algorithm directly jump to the test mode. In test mode , the user tests the 
selected interface by displaying the output on the LEDs mounted on the LED board to get familiar with 
the interface without using the robotic device. When the frontalis muscle cap control interface is selected, 
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the user can do the MVC calibration again (if needed) by simply pressing once the push-button. If the test 
mode output confirms to the expected program behavior and user is ready to use the device, he or she can 
switch to the device mode , where, motion of robotic device is controlled according to FSM in Figure 6.14. 
The switching from test mode to device mode is achieved by pressing the push-button for more than one 
second and is represented in the FSM in Figure 6.14 by the event e$. The process repeats every time the 
user switch to other control interface. 


Tests with chronic patients 

The Frenchay Arm Test. 

Six chronic stroke patients (five male, one female, age 40 — 62) took part to the tests on how the Soft- 
SixthFinger can be used for hand grasping compensation. The proposed compensatory tool can be used by 
subjects showing a residual mobility of the arm. For being included in the experimental phase, patients 
had to score < 2 when their motor function was tested with the National Institute of Health Stroke Scale 
(NIHSS) [78], item 5 “paretic arm”. Moreover, the patients had to show the following characteristics: 
normal consciousness (NIHSS, item la, lb, lc = 0), absence of conjugate eyes deviation (NIHSS, item 
2 = 0), absence of complete hemianopia (NIHSS, item 3 < 1), absence of ataxia (NIHSS, item 7 = 0), 
absence of completely sensory loss (NIHSS, item 8 < 1), absence of aphasia (NIHSS, item 9 = 0), 
absence of profound extinction and inattention (NIHSS, item 11 < 1). 

The goal of the tests was to verify how quickly the patients can learn to use the device and its EMG 
control interface. We performed a fully ecological qualitative test, the Frenchay Arm Test [75]. The test 
consisted of five tasks to be executed within three minutes: 

1. Task 1 : Stabilize a ruler, while drawing a line with a pencil held in the other hand. To pass, the ruler 
must be held firmly. 

2. Task 2: Grasp a cylinder (12 mm diameter, 5 cm long), set on its side approximately 15 cm from the 
table edge, lift it about 30 cm and replace without dropping. 

3. Task 3: Pick up a glass, half full of water positioned about 15 to 30 cm from the edge of the table, 
drink some water and replace without spilling 1 . 

4. Task 4: Remove and replace a sprung clothes peg from a 10 mm diameter dowel, 15 cm long set in a 
10 cm base, 15 to 30 cm from table edge. Not to drop peg or knock dowel over. 

5. Task 5: Comb hair (or imitate); must comb across top, down the back and down each side of head. 

The patient scored 1 for each of the successfully completed task, while he or she scored 0 in case of fail. 
The subject sat at a table with his hands in his lap, and each task started from this position. He or she 
was then asked to use his or her affected arm/hand to execute the tasks. Although the Frenchay arm test 
has not been specifically designed for evaluating compensatory tools, it has shown good reliability in 
measuring functional changes in stroke patients when comparing with other upper limb assessments [75]. 
The Frenchay Arm Test contains manipulation tasks of everyday life activity that evaluate the capability 
of grasping an object without a deep involvement of the patient arm. Other tests like, e.g., ARAT and 
UEFT [136], are more suitable for the evaluation of arm mobility which is out of the scope of this work. 

! Note that for safety reasons we did not use water in presence of electronic components. 
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Task 1: Stabilize a ruler Task 2: Grasp a cylinder 



Task 3: Pick up a glass Task 4: Remove a sprung 



Task 5: Comb hair 


Figure 6.6: The five tasks of the Frenchay Arm Test. 

Table 6.2: Results of the Frenchay Arm Test for the patient 1 to patient 3 with and without using the Soft-SixthFinger 
(SSF) 


Frenchay Arm Test 

Pal 

with 

dent 1 

without 

Pal 

with 

dent 2 

without 

Pal 

with 

dent 3 

without 

Stabilize a ruler 

1 

1 

1 

1 

1 

1 

Grasp a cylinder 

1 

0 

1 

0 

1 

0 

Pick up a glass 

1 

0 

1 

0 

1 

0 

Remove a sprung 

0 

0 

0 

0 

0 

0 

Comb hair 

0 

0 

0 

0 

0 

0 


Patients wore the Soft-SixthFinger in their paretic limb, the left hand for two subjects and the right one 
for the other four. The number of modules on the device was chosen according to the selected tasks. Seven 
modules were used in order to grasp the proposed objects .Written informed consent was obtained from all 
participants. The procedures were in accordance with the Declaration of Helsinki. The rehabilitation team 
assisted the subjects during a training phase that lasted for about one hour. During this phase, the optimal 
position of the device on the arm, according to the patient motor deficit, was evaluated. Moreover, the 
frontalis muscle cap parameters were tuned according to the patient. After the training phase, the subjects 
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Table 6.3: Results of the Frenchay Arm Test the patient 4 to patient 6 with and without using the Soft-SixthFinger 
(SSF) 


Frenchay Arm Test 

Pal 

with 

dent 4 

without 

Pal 

with 

dent 5 

without 

Pal 

with 

dent 6 

without 

Stabilize a ruler 

1 

1 

1 

1 

1 

1 

Grasp a cylinder 

1 

0 

1 

0 

1 

0 

Pick up a glass 

1 

0 

1 

0 

1 

0 

Remove a sprung 

0 

0 

0 

0 

0 

0 

Comb hair 

0 

0 

0 

0 

1 

0 



Figure 6.7: Examples of adaptive kitchen aids designed to be used with only one hand. On the left, a case used as aid 
for bottle and jar opening. On the right, a toothpaste dispenser. Pictures courtesy of Elderstore® 


had three minutes to perform the Frenchay Arm Test. Three patients tried the extra-finger for the first 
time. All the subjects performed the test two times, one without and one with the Soft-SixthFinger. The 
starting condition was selected randomly. The results of the test are shown in Table 6.2 and Table 6.3 for 
the six patients. Screenshots of the tasks are reported in Fig. 7.4. Note that in the execution of Task 1 the 
Soft-SixthFinger do not interfere with the paretic limb action. The patients can stabilize the ruler without 
using any external help, so the device is kept in its rest position. 

Bimanual tasks. 

The latter phase of post-stroke rehabilitation is based on the learning of newly acquired motor strate¬ 
gies to compensate the neurological deficit. These strategies may sometimes be neither ergonomic nor 
ecological, or may even increase pathological motor patterns, usually by worsening tonic flexion at the 
forearm of the paretic limb [137]. Some compensation techniques take also advantage of dedicated objects 
that allows the users to execute typical bimanual tasks only with the healthy hand. An example of available 
aids is reported in Fig. 6.7. However, the use of such tools is usually limited to the structured houses of 
the patients, restricting the possibilities of the patients to exploit them outside. The Soft-SixthFinger is 
a portable compensatory tool that can be carried as a bracelet when not used. This allows the patients 
to bring the devices wherever they want. The regained capability of grasping object with the help of the 
device, stimulate the patient to use his paretic limb so preserving residual mobility. As a proof of concept, 
we tested the device in four different bimanual tasks typical of ADL. The four tasks were: 
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Figure 6.8: The four tasks. From the top left, clockwise: unscrew ajar, open a can, squeeze a toothpaste tube and open 
a squared can. 


• unscrew the cap of a tomato jar; 

• open a can of beans; 

• open a squared can of cat food; 

• squeeze toothpaste tube over a toothbrush. 

In all these bimanual tasks, the paretic limb and the Soft-SixthFinger work together to constrain the motion 
of the object while the healthy hand manipulate it (e.g., constrain the motion of the tomato jar while the 
healthy hand is unscrewing its cap). Pictures of the execution of the four tasks are reported in Fig. 6.8. All 
the patients were able to execute the four tasks without requiring a specific training. Note that, thanks to 
the passive compliance embedded in its structure, the device was able to adapt also to squared shapes like 
the can of cat food. 

Questionnaire. 

After the Frenchay Arm Test and the bimanual tasks, we investigated the users’ subjective satisfaction and 
possible concerns related to the proposed system. According to [138], questionnaires and interviews are 
useful methods for studying how users use systems and what features they particularly like or dislike. The 
patients were asked to fill the Usefulness-Satisfaction-and-Ease-of-use-questionnaire (USE, [109]) that 
focuses on the experience of the system usage. This questionnaire uses a seven-point Likert rating scale. 
Mean and standard deviation (SD) of the questionnaire factors are presented in Table 6.4. 


6.3 An EMG interface for the Control of motion and compliance of 
fully actuated supernumerary robotic finger 


In this part of the chapter, we present an EMG interface for the control of motion and compliance of fully 
actuated supernumerary robotic finger. The motion of the robotic extra finger is controlled through gesture 
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Table 6.4: Questionnaire factors and relative marks. The mark ranges from “1 = strongly disagree” to “7 = strongly 
agree”. Mean and standard deviation (Mean (SD)) are reported. 


Questionnaire factors 

Mean (SD) 

Usefulness 

4.6(0.8) 

Ease of use 

5.6(0.6) 

Ease of learning 

6.5(0.8) 

Satisfaction 

5.8(0.7) 


recognition and its compliance is regulated by EMG signal amplitude variations. In particular, we used 
Myo Armband for gesture recognition to be associated with the motion control of the robotic device and 
surface one channel EMG electrodes interface to regulate the compliance of the robotic device. 

The study also present an updated version of the fully actuated robotic extra finger where the ad¬ 
duction/abduction motion is realized through ball bearing and spur gears mechanism. The proposed 
interface is validated with two sets of experiments related to compensation and augmentation. In the first 
set of experiments, different bi-manual tasks have been performed with the help of the robotic device 
and simulating a paretic hand since this novel wearable system can be used to compensate the missing 
grasping abilities in chronic stroke patients. In the second set, the robotic extra finger is used to enlarge the 
workspace and manipulation capability of healthy hands. In both sets, the same EMG control interface 
has been used. The obtained results demonstrate that the proposed control interface is intuitive and can 
successfully be used, not only to control the motion of a supernumerary robotic finger, but also to regulate 
its compliance. The proposed approach can be exploited also for the control of different wearable devices 
that has to actively cooperate with the human limbs. 

The fully actuated supernumerary robotic finger 

The proposed supernumerary robotic finger is composed of modules connected to partially resemble the 
human finger mechanical structure. Human hand fingers, excluding the thumb, consists of four phalanges 
connected by three joints [55]. The structure of the thumb is different since it has two joints at the base for 
the anterposition or retroposition combined with the radial or palmar abduction motions. The other fingers 
are capable of both adduction-abduction and flexion-extension motions. The finger’s kinematic model 
is typically approximated by using simple revolute joints. This approximation is an effective means of 
modeling, as these are in fact the same as compared to proximal and distal joints of humans. The proximal 
and distal interphalangeal articulations can have only flexion/extension motion capabilities and typically 
are represented with a single DoF revolute joint. The metacarpal joints have both adduction/abduction 
and flexion/extension motion capabilities and can be modeled as a 2-DoFs joint composed of two revolute 
joints with orthogonal rotation axis (universal joint). 

We designed the kinematic structure of the robotic extra finger such that one motor is adopted to actuate 
each DoF of the robotic finger so to replicate the flexion/extension motion of the human finger. While, at the 
robotic finger base, two motors realize the adduction/abduction and flexion extension motion to replicate 
metacarpal joint. We used four modules in a pitch-pitch configuration for the flexion/extension motion of 
the finger so to approximate the average length of the whole hand [139]. The adduction/abduction motion 
of base joint is obtained using spur gears that allows to transmit motion and power. One of the spur gear 
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Figure 6.9: On left the exploded cad view, while on right the prototype of the robotic extra finger. Four modules are 
used for the flexion/extension motion, while the revolute joint based on bearings and spur gears mechanism at the 
finger base is used for the adduction/abduction motion. The device can be worn on the forearm through an elastic 
band. 


Table 6.5: The technical details of supernumerary robotic finger 


Device weight 

0.16 kg 

Module dimension 

42 x 33 x 20 mm 

Module weight 

16 g 

Support base dimension 

78 x 24 x 5 mm 

Support base weight 

28 g 

Max torque per motor 

0.15 Nm 

Max payload 

0.61 kg 

Velocity of one module 

0.5 rad/s 

External battery pack 

5 V 


is mounted on the shaft of the servo motor, while the other is placed on the base of the finger. We used 
bearings to decrease the friction during rotation. 

The finger design is based on the principle of modularity. Each module consists of a servomotor, a 
3D printed structure (Acrylonitrile Butadiene Styrene, ABSPlus, Stratasys, USA) and a soft rubber part 
mounted on front to increase the friction at the contact area. The actuators used are the HS55 MicroLite 
servo motors. The modules are connected so that one extremity of each module is rigidly coupled with the 
shaft of the motor through screws, while the other has a pin joint acting as re volute joint. The exploded 
view and the prototype of the device are shown in Fig. 6.9. 

The servo motors are pulse width modulation (PWM) controlled. The PWM signals are generated by a 
microcontroller At-mega 328 installed on an Arduino Nano board. The portability and wearability of the 
device is improved by enclosing all the electronics circuitry in a 3D printed housing which is attached to 
the finger base support. An external battery pack (5 V) is used to provide power to the actuators. Technical 
details on the device are summarized in Table 6.5. 

We used surface EMG electrodes to measure electrical signals associated with the subject muscle 
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Figure 6.10: The complete system: the EMG interface on one arm while the supernumerary robotic finger on the other 
arm. Myo Armband is positioned on the forearm while the one channel interface is placed on the biceps muscle. 



Figure 6.11: Block diagram of complete system. On top left, the block diagram of EMG one channel interface 
is shown, where a) surface electrodes b) snap leads c) acquisition board d) control board. On top, right, the Myo 
Armband with its major components e) logo LED f) status LED g) expandable flex h) micro USB charging port i) 
electrical sensor. 


activation. In particular, we used two EMG interfaces on the arm, one to record the continuous EMG 
amplitude aiming to regulate the compliance of the device and the second to recognize different gestures to 
be associated with the motion of the robotic finger. Both EMG interfaces are placed on one of the arms, one 
at the biceps and other at the forearm, while having the robotic finger on other arm as shown in Fig. 6.10. 
We developed the circuit acquisition and signal conditioning board for one channel EMG electrodes to 
measure continuously the biceps muscle EMG signal variations. We used the Myo Armband to recognize 
the gestures at forearm position. Fig. 6.11 shows the block diagram of the proposed system. Both, EMG 
one channel interface and Myo Armband are connected to a computer through Bluetooth communication. 
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Figure 6.12: On left, (a) the maximum voluntary contraction (MVC) proportional to the biceps muscle contraction is 
shown. While on right, (b) the graph between A q and percentage of MVC for different values of kd is plotted. 


The PC communicates with the robotic device controller (Arduino) through serial communication which 
in turn controls the motion and compliance of the supernumerary robotic finger. Section 6.3 describes the 
development of the acquisition and signal conditioning board for one channel EMG interface followed by 
the compliance regulation of the robotic device through the amplitude variation of the acquired biceps 
EMG signal. In Section ?? we describe the gesture recognition through the Myo Armband and their 
association with the motion control of the supernumerary robotic finger through a finite state machine 
(FSM). 

One channel EMG electrodes interface and robotic device compliance regulation 

We used non-gelled reusable silver/silver-chloride electrodes for the EMG one channel interface. These are 
recommended for biopotentials recording since they present the lowest noise interface [131]. The design 
and development of the EMG signal acquisition board is carried out, while considering the requirements 
associated with bandwidth, dynamic range and physiological principles. The typical EMG waveform is 
characterized with a spectral content between 10 to 250 Hz with amplitude up to 5 mV, depending on 
the particular muscle [132]. The acquired EMG signal is sampled at 1 kHz (double EMG band) to avoid 
aliasing. The reference value of received EMG were normalized using maximum voluntary contraction 
(MVC) technique [133]. This solution avoids the problems related to the high influence of detection 
condition on EMG signal amplitude. In fact, amplitude can greatly vary between electrode sites, subjects 
and even day to day measures of the same muscle site. We implemented an auto-tuning procedure based 
on the MVC in order to better match the user-dependent nature of the EMG signal. The implemented 
MVC routine consists of a 3 s time window in which the user slowly starts increasing the contraction of 
the biceps muscle to reach their maximum effort. Fig. 6.12-a shows the relation between EMG (percentage 
of MVC) signal at biceps and time (ms). The relationship between EMG signal and muscle tension is non 
linear. The MVC value itself is not calculated as a single peak data point because that would allow too 
much variability. In order to obtain a more stable reference value, we have implemented an algorithm 
using a sliding window technique of 500 ms duration to compute the mean amplitude of the highest signal 
portion acquired during the 3 s time window. The technical details of the EMG acquisition board are 
listed in Table 6.6. The EMG signal acquired through the developed one channel interface is used to 
control the stiffness of each module of the robotic device through the implemented control scheme based 
on servo motor, explained later in this section. In precision grasps, the contact is obtained at the fingertip 
module. In power grasps, in order to obtain suitable contact points, we set different closing priorities 
according to the position of the module in the finger. If the fingertip module comes in contact first, the 
remaining modules stop. If another module comes in contact first, modules below to it stop, while the 
module above keeps moving. The same methodology is followed for other intermediate modules. Finally, 













6.3. An EMG interface for the Control of motion and compliance of fully actuated supernumerary robotic 
finger 99 

Table 6.6: Technical details of EMG signal acquisition and conditioning board 


EMG acquisition box dimensions 

3.5 x 3.1 x 4.5 cm 3 

EMG acquisition box weight 

46 g 

Principle 

Differential voltage 

Number of electrodes 

3 

Bandwidth 

10 - 400 Hz 

Gain 

1000 

Input Impedance 

100 GOhm 

CMRR 

110 dB 

Operating voltage 

Vcc = 3.3 V 


if the module at the base of the finger is the first to come in contact, two different behaviors can occur: 

i) one of the intermediate modules get in contact before the fingertip; ii) the fingertip module comes in 
contact first. In case i) the modules above are left free to move to get in contact with the object; in case 

ii) the other intermediate modules stop. The contact of a module can be detected comparing the desired 
angle commanded to the servo motor ( q ^ es ) with the actual position read by the encoders (q m ). When 
Aq = || Qdes — qm || overtake a predefined threshold a contact is recognized. It is possible to control the 
compliance of the device to guarantee the stability of the grasp. During the grasping phase the finger 
should be compliant so to favor the adaptation of the finger to the shape of the grasped object. Once the 
grasp is achieved, the stiffness of the finger should be increased so to tight the grasp. The finger stiffness is 
regulated from the user through the EMG interface by contracting the biceps. This approach is similar to 
the concept of teleimpedance introduced by Ajoudani et al. [140]. 

In the following we will explain how stiffness regulation has been obtained using servomotors. 
Generally, in active compliance control framework, the equation relating the motor torque to its position is 
given by 

r = kAq = k(q des - q m ) (6.1) 

where, q^s is the desired (reference) joint position , q m is the measured (current) joint value, and k is 
the stiffness constant [77]. Note that the compliant (or stiff) behavior of the joint is achieved by virtue 
of the control, differently from what happen in mechanical systems with a prevalent dynamics of elastic 
type.This controller is typically used with actuator that can be torque controlled. Servo motors are position 
controlled actuators where it is not possible to directly command the exerted torque. Even if the joint 
position deviates a little from the reference position in the clockwise direction, a large amount of torque 
is generated in the counterclockwise direction to compensate for this. This behavior is regulated by the 
controller embedded in the servo motor and cannot be modified. However, since inertia must be considered, 
we set up a rack-pinion gear mechanism connected with springs with calibrated stiffness to estimate the 
real relation between the angle error (difference between commanded and actual position of the motor) 
and the exerted torque. We called the arising stiffness constant of the motor k. We modified the servo 
motor to read its current position. The pinion gear was mounted on the shaft of the motor. One end of the 
rack gear was coupled with the motor pinion gear, while the other was attached to two springs with known 
stiffness. The other end of the springs were fixed (grounded). Once the servo moves to its goal position, 
it applies the force on the springs through the rack-pinion gear arrangement. The corresponding motor 
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torque can be computed by using the relationship r m = Fr where, r is the radius of the gear and F the 
force applied on the springs. F can be computed using F = k sp x. Here, the spring constant k sp , is known 
and displacement x, is measured through a scale. This torque-position relationship defines the standard 
stiffness of the servo motor which can not be changed by the user. Thus, the ultimate choice to vary the 
torque is the position error (second term in equation 6.1). We defined a scaling factor kd to modulate the 
position error. 

Thus the possible angle displacement A qi (t) at time instant t for the it h servo motor was computed as 

A qi(t) = k d (q des -q m ), 

We modified the servomotor in order to measure its actual position by accessing the internal encoder 
measurements. The only servomotor parameter that can be commanded is its desired position qd es - At 
time instant t the desired position for the i —th servomotor is computed as 


qdes,i(t) = q m ,i(t - 1) + A qi(t - 1). 


In presence of a rigid grasped object, the measured positions of the extra-finger joints do not change due 
to the object constraints. So that, changing the desired position of the servomotors through the scaling 
factor we can control the force exerted by the device onto the object. For calibration purpose, We mounted 
a Force Sensing Resistor (FSR) (408, Interlink Electronics Inc., USA) on single module. We pushed 
the module and recoded the A q against the applied pushing force for different values of kd. We used 
piecewise-linear functions to replace the force with the EMG signal amplitude variations in the resultant 
plot. In Figure. 6.12-b, the relation between the percentage of MVC and the arising angle displacement for 
one module is reported for different value of kd. Increasing the value of kd we get a less angle displacement 
of the servomotor. Finally, the resulting behavior was implemented in the device controller where the 
parameter kd, was varied proportional to the EMG signal acquired at the user biceps. In particular, the 
range of EMG signals was linearly mapped in the range 0.4 — 3 of parameter kd. 

We set priorities between modules for the simulated compliance variation, similarly to what we did for 
the grasping procedure. So that, if, for instance, only the fingertip module is in contact with the object, 
all the other modules change their stiffness accordingly. This solution allows to control the stiffness of 
modules that are not in contact with the object. 

EMG armband gesture recognition and robotic device motion control. 

We used a Myo Armband at forearm to recognize the hand gestures that control the device motions. 
This device has electrically safe setup with low voltage battery and Bluetooth LE protocol, eight surface 
EMG sensors working at frequency of 2200 Hz and 9-DoF IMU working at 50 Hz. The provided software 
development kit (SDK) is suitable for working with the recorded data and for developing standalone 
applications. EMG signals are filtered through notch filters at frequencies of 50 Hz and 60 Hz in order to 
take out any power-line interference. For the sake of simplicity, we considered the five gestures available 
with the SDK. These gestures mainly involve flexion/extension of fingers and flexion/extension of hand. 

We implemented specific types of grasps for both kinds of users in order to make better suitable to 
use the robotic finger with healthy hand or paretic hand. In particular, in case of healthy hand, we defined 
anatomically impossible grasps and ulnar grasps, see Fig. 6.13-(a),(b). In case of anatomically impossible 
grasp, the supernumerary robotic finger coordinates with human hand to grasp big size objects which can 
not be grasped using only one hand. In ulnar grasp configuration, the robotic device coordinates with 
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e. Bracelet position 


Figure 6.13: Examples of possible achievable grasps at working positions (a-d) and bracelet at rest position (e). In 
(a) and (b) the robotic finger coordinates with healthy hand to realize the anatomically impossible and ulnar grasp, 
respectively. While in (c) and (d) it interacts with paretic hand to realize power and precision grasp. 





ring and pinkie fingers to grasp and hold an object, while the upper part of the hand (thumb, index and 
medium fingers) is left free to do another task allowing, for instance, to hold multiple object in one hand or 
to unscrew a bottle cap with a single hand. In case of paretic hand users, we defined power and precision 
grasp as shown in Fig. 6.13-(c),(d). In the former, each module flexes with a fixed step size in order to 
wrap the finger around the object. In the latter, the target is to hold small size objects between the paretic 
limb and the device fingertip pad. To this aim, the fingertip is kept parallel to the paretic limb during 
flexion motion. The contact is expected to occur between the object and the fingertip module. Finally, the 
supernumerary robotic finger can actively be wrapped around the wrist as a bracelet when not used (see, 
Fig. 6.13-(e)). We implemented a trigger based FSM to control the motion of the robotic device. All the 
gestures were associated to a unique trigger signal. In Fig. 6.14-a, the gesture recognized through the Myo 
Armband are shown. In particular, fist -(event e±) switches the device from bracelet position to working 
position and vice-versa. Double to/?-(event e^) changes the grasp modalities. Patients with paretic hand 
can switch between precision and power grasp. When augmentation purpose is concerned, the user can 
switch between ulnar and anatomically impossible grasp. Wave out -(event es) corresponds to flexion and 
Wave zn-(event e±) is associated to extension. Finally, Finger spread-(event e$) can stop the motion of the 
robotic finger. 


6.4 Experiments 

In the following, we demonstrate how this interface and the wearable device can be effectively used both to 
compensate paretic hand functions and to augment healthy human hand capabilities. We performed a proof 
of concept study involving four healthy subjects (three male, one female, age 29 - 40). Written informed 
consent was obtained from the participants. The procedures were in accordance with the Declaration of 
Helsinki. The aim was to verify the potential of the approach and to understand how rapidly the subjects 
can successfully interact with the wearable device by using the proposed EMG control interface. The 
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Figure 6.14: (a) The recognized gestures and associated trigger signal, (b) The finite state machine which controls the 
motion of the robotic device in correspond to the generated gesture 



a. Opening coffee can b. Opening meat can c. Pouring water 



d. Opening mustard e. Opening gelatin box f. Opening tomato can 
container 


Figure 6.15: Supernumerary robotic finger helping in bi-manual task of ADL. All the bi-manual tasks can be completed 
in the presence of robotic device even if one hand is non-functional. 


experiments were divided into two categories. The first set of experiments was related to compensation of 
grasping function, while the second was related to augmentation of hand capabilities. In particular, the 
compensation experiments, shown in section 6.4, have been carried out asking to the subjects to simulate a 
paretic hand. We focused mainly on bi-manual tasks of activity of daily living (ADL). The augmentation 
experiments shown in Section 6.4 were performed with the healthy hand to show the effectiveness of the 
device in increasing the hand grasping abilities and workspace, e.g., allowing to grasp big size objects 
which can not be grasped using a single hand or holding multiple objects using the augmented hand, i.e., 
human hand and the supernumerary robotic finger. In both the experimental sets, the subjects used the 
EMG interface on one arm (three subject used the right arm, one the left), while the supernumerary robotic 
finger was worn on the other arm. The Myo Armband was positioned at the forearm, while the one channel 
electrodes interface on the biceps, see Fig. 6.10. 
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a. Unscrewing a cap b. Grasping bigger c. Grasping two balls 

of bottle box 



d. Opening door e. Soldering a board f. Grasping plate and glass 


Figure 6.16: Examples of tasks performed by the augmented hand, i.e., human hand plus supernumerary robotic finger. 
In all the tasks, the human healthy hand and robotic finger work together to complete the tasks which are impossible to 
do with human hand only. 


Compensation of paretic hand functions 

Among the different ADL we focused on those involving “hold and manipulate” tasks. Such activities, 
are generally bimanual tasks where one hand is used to restrain the motion of one object, while the other 
operates on it, e.g., unscrew the cap of a bottle, open a beans can, etc. The proposed supernumerary 
finger can be an effective aid in such tasks [2]. To demonstrate how the EMG interface can be used by 
patients, we asked to the subjects to execute different ADL involving a hold and manipulate task, see 
Fig. 6.15. In particular, the subject were asked to grasp an object using the gestures of the hand and to 
regulate the grasp tightness acting on the stiffness of the device. We used a subset of objects from the 
YCB grasping toolkit [107]. This toolkit is intended to be used to facilitate benchmarking in prosthetic 
design, rehabilitation research and robotic manipulation. The objects in the set are designed to cover a 
wide range of aspects of the manipulation problem. It includes objects of daily life with different shapes, 
sizes, textures, weight and rigidity. We considered six objects with different shapes to show how the 
robotic finger can adapt to the shape of the objects to realize a stable grasp. We mainly targeted the objects 
used in kitchen and in other ADL. During all the tests, subjects simulated the paretic hand and device was 
positioned on the arm as supposed to be used with the patients. 

The subject was asked to perform different bi-manual ADL without using the hand grasping ability 
where the device was worn. The contralateral arm was always used to control the device motion and joints 
stiffness. Fig. 6.15 shows the ADL tasks performed by simulating a paretic hand. All the targeted tasks 
normally require two healthy hands, but have been successfully executed with the aid of the robotic extra 
finger even if one hand was non-functional. The robotic finger and paretic hand was used to constrain the 
object, while healthy hand was used for manipulation. Fig. 6.15-a,b,d,e,f show the example of opening the 
cans, box and bottle with various shapes and different caps. Fig. 6.15-c reports the task of pouring water 
from a bottle while holding the glass with the help of robotic device and paretic arm. All the task were 
fulfilled controlling the device through the proposes interface. The subjects used hand gestures to shape 
the finger around the object. Later, they controlled the grasp stiffness by contracting the controlateral arm 
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biceps. Note that all the “opening” tasks required stiffness control to be executed. In fact, while compliant 
joints are preferable to adapt the shape of the finger to the object to grasp, a stiff device is necessary to 
achieve the stable grasps necessary while unscrewing the caps. 



(a) Forces exerted by the modules on (b) Positions of the modules during a 

the grasped object during a power power grasp. 

grasp. 



(c) Forces exerted by the modules on (d) Positions of the modules during a 

the grasped object during a precision precision grasp.. 

grasp. 


Figure 6.17: Forces and positions of modules in both power and precision grasp. 



(a) Raw EMG signal captured by 
the one channel interface during the 
execution of the task reported in 
Fig. 6.15-a. 



(b) The processed EMG signal used 
to compute the value of parameter 
kd- 


Figure 6.18: EMG signal for compliance regulation of robotic finger. 
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Augmenting healthy hand function through the proposed system 

In this experiments, the subject were asked to grasp a set of objects with the augmented hand to prove the 
effectiveness of the extra robotic finger in enlarging the human hand workspace and dexterity. We targeted 
tasks involving either anatomically impossible grasp or ulnar grasp. In the former case, the subject were 
asked to grasp relatively big size objects which cannot be grasped using only one hand. In the latter case, 
the users tried to grasp objects only using the ring and the pinkie fingers opposite to the sixth finger and to 
perform another operation with the remaining fingers (thumb, index, middle). In Fig. 6.16-a the user is 
unscrewing a cap from a bottle using only one hand. Ulnar grasp is used to keep firm the bottle, while 
the other fingers can unscrew the cap. Fig. 6.16-b shows the example of grasping big size box with the 
augmented hand that is impossible to grasp with the human hand only. Holding multiple objects with the 
augmented hand is shown in Fig. 6.16-c and Fig. 6.16-f. The example illustrated in Fig. 6.16-d involves 
the task of opening the door using the handle, while carrying an heavy bag with the hand. The user was 
able to turn the handle to open the door using the robotic device, while keep holding the bag with the hand. 
The 6.16-e is another example where the user can solder a circuit board, while holding the board by robotic 
finger, ring and pinkie. The thumb, index and middle finger are used to hold soldering gun. Note that, all 
the tasks are either impossible or at least very difficult to be carry out with a single hand. All these tasks 
were successfully fulfilled by all the subjects with the help of the EMG interface and the supernumerary 
extra finger. Also in this subset of examples, the possibility to control both motion and joint stiffness of 
the device was exploited by the users. 


6.5 Results and discussion 

In Section 6.2, we described the tasks performed by the subjects to prove the usability of the proposed 
EMG interface and the novel supernumerary finger prototype. In the following, we will give the details of 
the position of the device and the forces exerted on the grasped object for two particular type of grasps, 
i.e., power and precision grasps. Figs. 6.17a-6.17d reported the behavior of the device during power and 
precision grasping, respectively. In particular, Figs. 6.17a and 6.17b refer to the power grasp reported in 
Fig. 6.15-a, while Fig. 6.17c and Fig. 6.17d refer to the precision grasp reported in Fig. 6.16-e. We report 
only these examples for the sake of brevity. Figs. 6.17a-6.17d represent the average of five repetitions of 
the same subject. To measure the forces exerted on the objects, we equipped each module of the extra 
finger with a Force Sensing Resistor (FSR) (408, Interlink Electronics Inc., USA). The user was asked 
to command the supernumerary finger till the grasp is obtained. Once the device was in contact with the 
object, the user increased the stiffness of the device by co-contracting his/her biceps, see Fig. 6.18a. The 
contraction of the biceps was read by the EMG interface and the value of kd was increased, see Fig. 6.18b. 
This variation produced a variation on the desired angle qd es of the modules, while the read actual position 
of the modules remained the same due to the constrain imposed by the object, see Figs. 6.17b and 6.17d. 
The variation of the desired angles produces however an increase of the force exerted by the device onto 
the object, as shown in Figs. 6.17a and 6.17c. So that, by co-contracting the biceps the user can regulate 
the grasp tightness. As expected, in power grasps all the modules move of a similar angle so to wrap the 
object. All the modules also contribute to the grasp tightness applying force on the object. Differently, in 
precision grasp the fingertip module is the only module exerting force. The module motion is opposed to 
the direction of the other three modules so to leave the fingertip parallel to the hand. 

The proposed EMG interface and the novel robotic extra finger prototype successfully enabled the 
users to complete all the targeted tasks both related to augmentation and compensation. The experiments 
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proved that the presented system can be an effective aid both in augmenting the healthy human hand or in 
compensating its missing abilities in case of a disease. The proposed EMG control interface resulted to 
be intuitive and simple. The users were able to generate multiple control inputs without using sensorized 
gloves on human hand and were able to modulate the compliance of the robotic device in proportional 
to the EMG signal amplitude variations at biceps. Moreover, the upgraded version of the device with 
additional adduction/abduction degree of freedom increased the dexterity of the robotic device allowing 
more complex operation especially when hand augmentation was considered. 

Conclusion 

The second part of this chapter presented an EMG control interface for a supernumerary robotic finger that 
can be used to control motion and joint stiffness. The aims are grasping compensation in chronic stroke 
patients and augmentation of human healthy hand to enhance its grasping capabilities and workspace. 
The motion of the robotic finger is controlled through gesture recognition and its compliance is regulated 
by EMG signal amplitude variations. In particular, we proposed Myo Armband to recognize the user 
gesture to control the motion of the robotic device. We developed EMG one channel electrode interface 
to modulate the compliance of the robotic device through a control scheme based on servo motor. We 
developed a five DoFs device that can be worn on the user wrist by an elastic band. We validated the use of 
device in augmenting and compensating the human hand grasping abilities. In particular, we showed how 
the supernumerary-robotic finger can play the role of an extra thumb enlarging the human hand workspace 
and the hand dexterity and how it can compensate the missing abilities of the non-functional hand in case 
of stroke patients. We demonstrate through experiments that the same interface can be used by patient and 
healthy subjects to control different flexion trajectories and to regulate the grasp tightness. 



Chapter 7 

From grasp compensation towards hemiparetic upper limb 
rehabilitation 


A high number of the chronic stroke patients do not recover a full mobility of their affected upper limb. 
Deficits in motor execution ranges from weakness of wrist/finger extensors to inefficient scaling of grip 
force and peak aperture. This means that both hand and arm impairments contribute to a low capability 
of grasping and manipulating objects. Patients with hemiparesis often have limited functionality in the 
paretic limb. The standard therapeutic approach requires the patient to attempt to make use of the paretic 
arm and hand even though they are not functionally capable, which can result in feelings of frustration and 
failure. Moreover, the hemiparetic patients also face challenges in completing many bimanual tasks in 
activity of daily living (ADL). 

In this chapter, we present two robotic devices to provide the needed assistance during paretic upper 
limb rehabilitation involving both grasping and arm mobility to solve task-oriented activities. In particular, 
we propose the combination of the Soft-SixthFinger with the zero gravity arm support, the SaeboMAS. 
The Soft-SixthFinger is a wearable robotic supernumerary finger designed to be used as an active assistive 
device by post stroke patients to compensate the paretic hand grasp. The device works jointly with the 
paretic hand/arm to grasp an object similarly to the two parts of a robotic gripper. The SaeboMAS is 
mobile arm support to neutralize gravity effects on the paretic arm specifically designed to facilitate and 
challenge the weakened shoulder muscles during functional tasks. The proposed system has been designed 
to be used during the rehabilitation phase when the arm is potentially able to recover its functionality, but 
the hand is still not able to perform a grasp due to the lack of an efficient thumb opposition. The overall 
system also act as a motivation tool for the patients to perform task-oriented rehabilitation activities.With 
the aid of proposed system, the patient can closely simulate the desired motion with the non-functional 
arm for rehabilitation purposes, while performing a grasp with the help of the Soft-SixthFinger. As a 
pilot study we tested the proposed system with a chronic stroke patient to evaluate how the mobile arm 
support in conjunction with a robotic supernumerary finger can help in performing the tasks requiring 
the manipulation of grasped object through the paretic arm. In particular, we performed the Frenchay 
Arm Test (FAT) and Box and Block Test (BBT). The proposed system successfully enabled the patient to 
complete tasks which were previously impossible to perform. 

This Chapter is an extended and revised version of the work published in [141] 


7.1 Introduction 

Long-term disabilities of the upper limb affects millions of stroke survivors [20]. More than 80% of 
individuals who experience severe hemiparesis after stroke cannot completely recover hand and arm 
functionality [25]. The improvement of the paretic hand functionality plays a key role in the functional 
recovery of stroke patients with a paretic upper limb [64, 65]. Different motor impairments can affect the 
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Figure 7.1: The proposed system: The Soft-SixthFinger works with the paretic upper limb to compensate for hand 
grasping functionality. The motion of the device is controlled by a wearable EMG interface embedded in a cap. The 
Passive arm support compensates the gravity force of the paretic upper limb. 

hand both at motor execution and motor planning/learning level ranging from weakness of wrist/finger 
extensors, increased wrist/finger flexors tone and spasticity, co-contraction, impaired finger independence, 
poor coordination between grip and load forces, inefficient scaling of grip force and peak aperture, and 
delayed preparation, initiation, and termination of object grip [23]. 

In the last two decades, several rehabilitation teams have started to integrate robotic-aided therapies in 
their rehabilitation projects. Such treatments represent a novel and promising approach in rehabilitation of 
the post-stroke paretic upper limb. The use of robotic devices in rehabilitation can provide high-intensity, 
repetitive, task-specific and interactive treatment of the impaired upper limb and can serve as an objective 
and reliable means of monitoring patient progress [68, 69, 70]. Most of the proposed devices for hand and 
arm rehabilitation are designed to increase functional recovery in the first period after the stroke when, in 
some cases, biological restoring and plastic reorganization of the central nervous system take place [24]. 
However, even after extensive therapeutic interventions in acute rehabilitation, the probability of regaining 
functional use of the impaired hand is low [142]. For this reason, we recently started investigating on 
robotic devices for the compensation of hand function in chronic stroke patients. In [16, 18, 29] we 
introduced a wearable robotic extra finger that can be used as an active compensatory tool for grasping 
action by chronic stroke patients. The principle of use of the proposed extra finger is rather simple and 
intuitive. The device can be worn on the paretic forearm by means of an elastic band. The robotic finger 
and the paretic hand act like the two parts of a gripper working together to hold an object, see Figure. 7.1. 
This solution represents the minimum robotic complexity necessary to grasp and hold and object. The 
user is able to control the flexion/extension of the robotic finger through an EMG interface placed on the 
patient forehead [30]. In [2] we showed how the robotic sixth finger can be used in Activities of Daily 
Living (ADL) involving common bimanual tasks including opening cans and jars with different closing 
system and shapes. 

In our preliminary experiments with patients, we noticed that compensation process by using extra 
finger motivates the patient to use her or his muscles to coordinate with the device for the completion 
of the task. Thus, the extra finger acts like an active and motivational assistance device. This approach 
encourages the patients to use their potential and residual abilities effectively instead of being fully 
dependent on the motion of robotic device like passive assistive devices. The use of a robotic extra finger 
also limits the drawbacks of other compensatory strategies [72] that lead to a disuse of the affected arm 
and hand often lead to the learned non-use phenomenon of the hemiplegic upper extremity [137]. Based 
on these observations, we started exploring a possible use of the supernumerary finger as a augmentative 
device also during rehabilitation in acute and sub-acute phases. In particular, we consider a possible 
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integration of the robotic sixth finger with a mobile arm support (MAS) to compensate for arm weight. 
Devices for compensating the gravity force of the arm can be used during stroke rehabilitation therapy to 
increase the quality and quantity of movements and reduce the fatigue made by patients with upper limb 
impairment [143, 144, 145], especially in the sub-acute post-stroke phases. 

Supporting the weight of the arm is thought to benefit upper limb rehabilitation primarily by increasing 
capacity in terms of intensity or volume of therapeutic exercises [146]. In [147] a study on chronic 
stroke patients reported that gravity supported arm exercises can improve arm movement ability. A MAS 
counteracts the effects of gravity while facilitating and promoting functional movement. In addition to 
using a MAS for function, research has shown that gravity compensation devices are also effective for 
improving motor control, decreasing spasticity and minimizing fatigue [143, 144, 145]. 

In this work, we present a possible solution for an augmented motor rehabilitation which may increase 
the paretic upper limb recover of functions thanks to the combination of a robotic extra finger, called 
the Soft-SixthFinger [2], and the SaeboMAS (Saebo, Charlotte, USA). The aim of the Soft-SixthFinger 
is not to assist the paretic hand motion of the patient, but rather to add just what is needed to grasp: an 
extra thumb. The robotic extra finger is worn on the user’s forearm and can accomplish a given task in 
cooperation with the paretic limb, see Figure.7.1. The robotic extra finger has been designed to guarantee 
high wearability and portability with kinematics and actuation inspired by recent works on underactuated 
compliant robotic hands [58]. In particular, the robotic extra finger is passively compliant due to its flexible 
joints, so that it automatically adapts to the grasped object, even of different sizes. Only one motor is used 
to control the device flexion/extension with a tendon-driven actuation. The patient can control the motion 
of the robotic extra finger through an EMG based interface. Such interface can recognize, through the 
acquisition of the Electromyography (EMG) signal measured at the frontalis muscle of the patient, when 
the patient voluntary moves his or her eyebrows upwards. Frontalis muscle contractions generate events 
that regulate the finger flexion/extension. The whole system is embedded in a cap. Electrodes can be easily 
placed on the patient’s forehead just wearing the interface. The high wearability of the Soft-SixthFinger 
allowed to easily integrate the device with the arm supports. The proposed system resemble the integration 
of MAS with active and passive orthoses [148, 149]. The clear advantages of our system is the ease of 
wear, the wearability and extreme portability due to a light weight and the ease of use. On the other side, 
hand orthoses also contribute to the rehabilitation of the hand and the wrist. Our system can be mainly 
used for rehabilitation of the arm as a way to promote arm motion even in case of weak proximal muscle 
when grasping function of the hand is not present yet. 

To test the proposed system, we set up a pilot experiment where a chronic stroke patient was asked 
to perform two different tests: a modified box and block test [136] and the Frenchay Arm Test [75]. The 
purposes of the experiment were to verify the integration of the Soft-SixthFinger with the SaeboMAS and 
to validate with a patient possible exercises useful during rehabilitation. 

The rest of the paper is organized as follows. In Section 7.2 all the parts composing the proposed 
system are described in details. Section 8.4 describes the performed experiments, while in Section 7.4 
a discussion on the possible use of the proposed system is reported. Conclusion and future works are 
reported in Section 7.5. 

7.2 The proposed system 

In this chapter we propose the Soft-SixthFinger to compensate the missing grasping abilities of paretic 
hand and the mobile arm support to help compensate for the effects of gravity of the impaired arm. Both 



7 . 2 . The proposed system 


110 



Figure 7.2: On left: Soft-SixthFinger, controller unit and eCap. On right: SaeboMAS for compensating the gravity of 
the arm. 

devices are shown in Figure. 7.2 and the details of each device are presented in this section. 

The Soft-SixthFinger and EMG interface 

The Soft-SixthFinger has been designed to compensate the missing grasping abilities of patients with 
neuromuscular disorder. The device is developed by robotic and rehabilitation teams taking into account 
the engineering design guidelines which are suitable to clinical needs. In particular, wearability, modularity, 
lightweight and robustness are fundamental structural features of the device. The wearability concept 
applied to the design includes also ergonomics and compact size. In addition to that, passive compliance 
and flexibility for shape adaptation, ease of use, comfort and intuitive user control interface, are from the 
functional point of view other important features of the device. The detail design and development of the 
soft robotic finger [2] are presented in chapter 4. The motion of the supernumerary finger is controlled 
by EMG frontalis muscle interface detailed in chapter 6. The patients can voluntary control the Soft- 
SixthFinger by contracting the frontalis muscle on their forehead. This muscle, due to a bilateral cortical 
representation, is always spared in case of a motor stroke, either of the left or of the right hemisphere. 
Activation of the muscle can be achieved by moving the eyebrows upwards. The bipolar EMG electrodes 
placement inside the cap provides twofold advantages, firstly the electrodes can easily be placed on the 
patient’s frontalis muscle, secondly the stroke patients can easily wear the eCap using their healthy hand 
without requiring any external help. 

The mobile arm support (SaeboMAS) 

The SaeboMASis used for gravity compensation of the impaired upper limb, allowing the patient to 
perform exercises, as well as self-care activities demanding a smaller muscle effort. The device can be 
table-mounted moreover a height adjustable rolling base makes the SaeboMAS mobile for easy relocation 
throughout user facility. It has an elbow support and a comfortable malleable forearm support with 
removable liners for infection control. Through an adjustable spring based parallelogram the SaeboMAS 
can offer various levels of assistance to the user, while a measurable graded tension scale is useful for 
tracking and documenting progress. 
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Figure 7.3: The box and block test: The subject grasped the object with the help of the soft-sixthfinger while using 
passive arm support to assist the paretic arm 


7.3 Pilot experiments with a chronic patient 

In the proposed pilot study, we performed two possible tests to asses rehabilitation progresses with a 
chronic stroke patient.Fig. 7.1 shows on the left side the coupling of the Soft-SixthFinger and the mobile 
arm support with the paretic arm. The Soft-SixthFinger is worn through the support base and elastic 
straps. The MAS is attached to the forearm through the custom brace and its end-effector support. The 
forearm is firmly secured to the brace using elasticized fabric wrap. The MAS prevents rotation of the 
brace in the vertical plane thus ensuring the forearm is always parallel to the table surface. The patient 
performed the a modified Box and Block Test and the Frenchay Arm Test. In ah the tasks, the subject used 
the Soft-SixthFinger to grasp the object while he used mobile arm support to support the weight of the arm. 
The subject performing the test showed a partial residual mobility of the arm (< 2 in the National Institute 
of Health Stroke Scale (NIHSS) [78], item 5 “paretic arm”). Moreover, the patient showed the following 
characteristics: normal consciousness (NIHSS, item la, lb, lc = 0), absence of conjugate eyes deviation 
(NIHSS, item 2 = 0), absence of complete hemianopia (NIHSS, item 3 < 1), absence of ataxia (NIHSS, 
item 7 = 0), absence of completely sensory loss (NIHSS, item 8 < 1), absence of aphasia (NIHSS, item 
9 = 0), absence of profound extinction and inattention (NIHSS, item 11 < 1). The rehabilitation team 
assisted the subject during a training phase for each test. During this phase, the optimal position of the 
devices on the arm, according to the patient motor deficit, was evaluated. The subject did preliminary trails 
to see his comfort in using the robotic devices and to get familiar with the control interface. 

The Box and Block test 

The Box and Block test measures unilateral gross manual dexterity [150]. We slightly modified the test 
in order to let the patient use the proposed system. In particular, we removed the first compartment of 
classic setup leaving the cubes free on the table. The patient was then able to use the arm support plus 
the extra finger to grasp the cubes and move them inside the second compartment. The subject used the 
Soft-SixthFinger to grasp the blocks from the table while the arm support was used to assist the paretic 
arm mobility. The test setup is report in Fig. 7.3. 

After the training phase, the patient performed the test three times with four different conditions: a) 















7.3. Pilot experiments with a chronic patient 


112 


Table 7.1: Results of the Box and Block Test, without using any device, only MAS, only SSF and SSF plus MAS 


Box and Block Test 

None 

SSF only 

MAS only 

SSF plus MAS 

Blocks per minute 

0 

3 

0 

6 


Table 7.2: Results of the Frenchay Arm Test, without using any device, only MAS, only SSF and SSF plus MAS 


Frenchay Arm Test 

None 

SSF only 

MAS only 

SSF plus MAS 

Stabilize a ruler 

1 

1 

1 

1 

Grasp a cylinder 

0 

1 

0 

1 

Pick up a glass 

0 

1 

0 

1 

Remove a sprung 

0 

0 

0 

0 

Comb hair 

0 

0 

0 

1 


without using any device, b) only MAS, c) only Soft-SixthFinger and d) the complete system. The results 
of the test are reported in Table 7.1 and screenshots of the tasks are shown in Fig. 7.3. On average, patient 
scored 8 blocks per minute while using the complete system (condition d). On the contrary, he scored 0 
while using none of the devices. 

The Frenchay Arm Test 

The test consists of five pass/fail tasks to be executed in less then three minutes. The patient scores 1 
for each of the successfully completed task, while he or she scores 0 in case of fail. The subject sit at a 
table with his hands in his lap, and each task started from this position. He or she is then asked to use the 
affected arm/hand to: 

1. TaskJ Stabilize a ruler, while drawing a line with a pencil held in the other hand. To pass, the ruler 
must be held firmly. 

2. Task32 Grasp a cylinder (12 mm diameter, 50 mm long), set on its side approximately 150 mm from 
the table edge, lift it about 300 mm and replace without dropping. 

3. Task-3 Pick up a glass, half full of water positioned about 150 to 300 mm from the edge of the table, 
drink some water and replace without spilling 1 (see Fig. 7.4). 

4. Task-4 Remove and replace a sprung clothes peg from a 10 mm diameter dowel, 150 mm long set in 
a 100 mm base, 150 to 300 mm from table edge. Not to drop peg or knock dowel over. 

5. Task _5 Comb hair (or imitate); must comb across top, down the back and down each side of head. 

When compared with other upper limb assessments, the Frenchay arm test has shown good reliability in 
measuring functional changes in stroke patients [75]. 

We performed the FAT with a chronic stroke patient using the proposed system to see how it can 
improve the performance of the subject. After the training phase, the subjects had three minutes to perform 

! Note that for safety reasons we did not use water in presence of electronic components. 
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Figure 7.4: Three tasks of the Frenchay Arm Test fulfilled thanks to the proposed system: on the left comb hair, in the 
center grasp a cylinder and on the right pick up a glass. 


the test. The subjects performed the tasks with four different conditions, without using any device, only 
MAS, only SSF and SSF plus MAS. The order of tasks was selected randomly. The results of the test are 
reported in Table 7.2 and screenshots of the tasks are shown in Fig. 7.4. Patient scored 3 out of 3 while 
using complete system, on contrary he scored only 0 without using the proposed devices. 

7.4 Discussion 

Stroke survivors have to reacquire a very high level of hand motor control before they actually can use the 
limb in ADL. This might explain why stroke patients that seems to show an adequate movement ability 
when monitored in the laboratory often do not use the limb into ADL with the expected regularity [15 1, 152]. 
With the aid of the robotic finger and of a passive arm support, the patients can better perform rehabilitation 
tasks and closely simulate the desired motion with the non-functional arm for rehabilitation purposes. The 
passive arm support can assist patient’s paretic arm in making more meaningful movements during the 
rehabilitation process, even when proximal arm muscles are still deficitary. It counteracts the effects of 
gravity to functionally integrate the patient’s affected arm during various tasks. The patient can exercise 
the impaired arm by positioning the extra robotic finger next to the object and can attempt to use their 
paretic arm to complete the tasks to the extent of their maximum abilities with minimum assistance from 
the robotic devices. The level of assistance to paretic arm can be adjusted by setting the stiffness of the 
MAS after monitoring the patient improvement. The tasks can be completed by the robotic finger and with 
the help of arm support even if the patient’s upper limb is too weak to do so, thus providing the patient with 
the motivation to attempt these tasks and minimizing the feelings of defeat that may arise when attempting 
to complete tasks beyond their current capability. This could help the patient to eventually regain the ability 
to complete these tasks on their own. The patient may benefit in the short term with increased feelings of 
independence while simultaneously working toward the long term goals of rehabilitation and healing. 

The proposed system aims to assist persons who are not able to make a functional grasp with their 
paretic arm and hand themselves. The creation of a functional grasp by means of the extra-finger flexion 
enables patients to execute task-oriented grasp and release exercises and practice intensively using repetitive 
movements. Repetition is an important principle in motor learning which reflects the Hebbian learning rule 
that connections between neurons are strengthened when they are simultaneously active (i.e., long term 
potentiation) [153]. Repetitive task training is a key modality of effective training in stroke [154]. The 
proposed dynamic system can be used in goal-directed activities and lowers the threshold for patients to 
participate in a greater variety of evidence-based treatment programs. In fact, notwithstanding the proven 
efficacy of classic CIMT [80], the obvious impossibility to perform bimanual tasks in daily living activities 
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may deeply affect patients’ motivation. This issue is overcome by our device, which instead encourages 
and motivates the patients to fully use their residual abilities, meanwhile possibly acquiring new grasping 
abilities. For these reasons, we could even say that the MAS plus Soft-SixthFinger device touches in 
parallel both cognitive and motoric aspects of the rehabilitation process. From the perspective of therapy 
efficiency and patient satisfaction, the use of an extra finger may be beneficial, because less individual 
therapy assistance is needed. To date, most clinical studies reporting the use of compensatory tools have 
been performed in chronic stroke patients. A clinical assumption is that the benefits of such an extra finger 
may be larger in sub-acute stroke patients, because learned non-use and secondary complications like 
contractures may be prevented. However, this has not yet been investigated systematically. Obviously, 
stroke is not the only field of application of the proposed device. All diseases leading to upper limb/arm 
paresis (myelopathies, amyotrophic lateral sclerosis, multiple sclerosis, muscular dystrophies) may be 
theoretically a suitable ground of application. 

The patients that could take advantage by using our proposed system may be those that show mild 
upper limb paresis associated with higher hand and fingers weakness in the first weeks after stroke, i.e., 
during the recovery phase [155]. Although the upper limb paresis is not complete, some of these patients 
are not able to move the arm against gravity, especially in the sagittal plane and, in addition, the absence of 
the grasping function makes impossible to perform a real “task-oriented therapy” . For example, Nijland et 
al. [156] showed that at nine days after stroke some patients showed the shoulder abduction movement, but 
the fingers extension, which is crucial for the grasping function, is absent. The presence of the shoulder 
abduction movement is not usually highly correlated with the ability to move the arm against gravity in 
the sagittal plane in which the most of the ADL take place. In this case study, we have used the MAS 
mainly for helping the patient, who was able to perform the shoulder abduction (frontal plane), to better 
perform shoulder flexion against gravity (sagittal plane) and to grasp objects for solving tasks with the 
Soft-SixthFinger due to the absence of hand and fingers movements. 


7.5 Conclusion 

In this chapter, we presented an approach to use grasp compensatory device and passive arm support in 
rehabilitation exercise for hemiparetic upper limb where grasping an object and its manipulation through 
arm is fundamental. We propose the use of our combined system for an “augmenting rehabilitation 
approach” in addition to the common physical therapy in those patients in which some upper limb 
movements are present, but an “ecological” and task-oriented therapy cannot be performed. Indeed, there 
are evidence that better outcome is favored by intensive high repetitive task-oriented and task-specific 
training during the recovery phase [157]. We presented our preliminary results in combining the Soft- 
SixthFinger with the zero gravity arm support, SaeboMAS. In our previous works on active tools for 
manipulation compensation we focused mostly on the grasping part developing an extra-finger that can 
adapt to different object shapes. However, we noticed that most of the patients testing our devices were 
still not able to perform basic rehabilitation tests designed for upper limb due to the poor mobility of 
the paretic arm/shoulder. In this chapter we tested the feasibility of the proposed system with one of our 
same chronic stroke patients. As a result the patient was able to perform the tasks which even needed the 
grasped object manipulation through paretic arm mobility. The proposed system is a first step toward the 
realization of an assisting platform when the arm is recovering its functionality, but the hand is still not 
able to perform a grasp. 



Chapter 8 

A magnetic compatible supernumerary robotic finger for 
functional magnetic resonance imaging (fMRI) acquisi¬ 
tions: device description and preliminary results. 


The Supernumerary robotic limbs are a recently introduced class of wearable robots that, differently from 
traditional prostheses and exoskeletons, aim at adding extra effectors (i.e., arms, legs, or fingers) to the 
human user, rather than substituting or enhancing the natural ones. However, it is still undefined whether 
the use of supernumerary robotic limbs could specifically lead to neural modifications in brain dynamics. 
The illusion of owning the part of body has been already proven in many experimental observations, such 
as those relying on multisensory integration (e.g., rubber hand illusion), prosthesis and even on virtual 
reality. For instance, participants responded positively to the possibility of controlling a six fingers hand 
in a virtual reality scenario, despite the structural difference as compared to their own hand. This study 
represents a first, original step towards our long term goal of better understanding of brain correlates 
of extra robotic finger’s use and of the relationship between extra-limbs and their eventual embodiment 
processes. In this chapter we present a description of a novel magnetic compatible supernumerary robotic 
finger together with preliminary observations from two functional magnetic resonance imaging (fMRI) 
experiments, in which brain activity was measured before and after a period of training with the robotic 
device, and during the use of the novel MRI-compatible version of the supernumerary robotic finger. 
Results showed that a network of motor-related cortical regions is modulated by the training with a 
supernumerary robotic finger, and that the usage of the MR-compatible robotic finger is safe and does not 
produce artifacts on MRI images. Moreover, it recruits primary as well as supplementary motor areas. 
Hence, the same motor network of a fully physiological voluntary motor gestures. Moreover, the usage of 
the MR-compatible robotic finger is safe and does not produce artifacts on MRI images. Moreover, the 
training with the supernumerary robotic finger recruits a network of motor-related cortical regions (i.e. 
primary and supplementary motor areas), hence the same motor network of a fully physiological voluntary 
motor gestures. 


8.1 Introducation 

Long-term disabilities of the upper limb affects millions of stroke survivors [20]. More than 80% of 
individuals who experience severe hemiparesis after stroke cannot completely recover hand and arm 
use [25]. Those who are left with single functional hand face problems in performing even simple activity 
daily living (ADL) tasks, specially bi-manual. Existing compensatory robotic devices like prostheses, 
cannot be used to help them since the hand of the patient, although frequently with limited mobility, is 
still present. Early results on the replacement of impaired hand with robotic devices are reported in [27]. 
However, this potential solution could be much less effective in chronic stroke patients where the whole 
arm often present a limited residual mobility. On contrary, rigid exoskeletons do not accommodate 
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variations in patient skeletal structure or joint misalignment and can produce compression forces on 
the soft tissue and joints during long-term use [28]. Moreover, most of the proposed exoskeletons are 
quite cumbersome, thus limiting the wearability and portability of the device. Besides exoskeletons and 
prostheses and their working principles, other robotic solutions which can compensate the missing grasping 
function are needed. Towards this aim, in [15, 18, 16], authors presented the supernumerary robotic fingers 
to augment the capabilities of healthy hand in order to enable it to do the tasks which normally require 
two hands (e.g. grasping bigger size objects, opening a cap of bottle etc). As an alternative approach, 
in [29, 30, 2] we proposed the use of a supernumerary robotic finger as an active compensatory tool for 
chronic stroke patients. The ultimate objective of the research is to achieve as much as possible the natural 
interaction of humans with supernumerary robotic devices, so that they can control these devices as if they 
actually belong to them. One interesting question that needs to be addressed is whether the practice with 
supernumerary robotic leads to plastic modifications in brain activity; additional questions may regard 
the embodiment or the perception of extra limbs as if they belong to the subjects’ body. Such effect has 
been proved in the past both with realistic limbs (i.e., rubber hands) and six-fingers avatars controlled 
using virtual reality [158, 33]. In 2011, Guterstam et al. [34] demonstrated the possibility of inducing 
the perceptual illusion of having a supernumerary right hand. Their findings suggest that the neural 
embodiment of a supernumerary limb is possible if it is aligned with the body in an anatomically similar 
fashion as the real limbs. In addition, it has been demonstrated that the size of the incorporated body part 
is not important and ownership illusion can be induced towards very small or large bodies [35]. Other 
studies showed that although multiple supernumerary limbs can be incorporated into the bodily image (i.e. 
the sense of ownership towards the supernumerary limb), only one can be included in the body schema (i.e. 
the ability to control the supernumerary limb) [36, 37]. This is why the study of brain activity during the 
use of supernumerary robotic limbs is a topic of particular interest. We designed and developed both MRI 
compatible and non-compatible robotic fingers to be used both inside and outside the fMRI scanner during 
everyday activities: so, either task related and trainin or use related brain activity can be investigated. 
To develop more complex experimental fMRI paradigm, it is a great interest to realize active interfaces, 
using electrically powered actuators and sensors to be used inside the MRI environment [159]. The use 
of non-ferromagnetic metals with higher stiffness and rigidity compared to plastic facilitates the design 
of smaller devices. In literature, several reports provide criteria to both develop and test MR compatible 
devices [160, 161]. Indeed, specific experimental protocols are described to evaluate compatibility and to 
evaluate location and timing zones where MR compatibility should be assessed. The various phenomena 
that can happen when a mechatronic device is placed adjacent to MR scanner should be taken into account. 
MR compatibility needs a set of supplementary constraints in the actuator and sensor choice and requires a 
proper design process. The common standard mechanical parts cannot be used in the MR environment 
because they usually contain ferromagnetic components. Majority of the actuators are electromagnetic 
devices and practically impossible to use during imaging. We took all these considerations into account 
during the design and development of our MR compatible supernumerary robotic finger. 

The remaining part of the chapter is organized as it follows. Section 8.2 describes the design and 
development of MR compatible supernumerary robotic finger while in Section 8.3 the MR non-compatible 
finger is detailed. Section 8.4 deals with the preliminary fMRI experiments that assessed the changes in 
neural responses associated to the usage of the supernumerary finger inside the scanner or to three days 
training with the supernumerary robotic finger outside the scanner. The results and discussions are outlined 
in Section 8.5. Finally, Section 8.6 presents the conclusion and future work. 
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8.2 MRI compatible supernumerary robotic finger 

We developed an MRI compatible finger to be used inside an fMRI scanner. Functional brain exploration 
methodologies, such as 1MRI are at present used to study brain correlates of perceptual, motor and 
cognitive processes. 



Figure 8.1: 3D printed MRI compatible finger having flexible material (TPU) as flexible joints and stiff (ABS) material 
acting as rigid links. The actuator used is a piezoelectric motor. 


We developed the MRI compatible robotic finger for fMRI experiments by properly choosing materials 
and actuators whose properties are fully compliant to MR compatibility. The proposed device consists of 
two main parts, a flexible finger and a support base, see figure 8.1. Each phalange of the finger has a 3D 
printed ABS (Acrylonitrile Butadiene Styrene, ABSPlus, Stratasys, USA) polymeric part that acts as a 
rigid link and a 3D printed thermoplastic polyurethane (Lulzbot, USA) part that realizes the flexible joint. 
The phalanges are connected by sliding the thermoplastic polyurethane part in the ABS part. A single 
actuator used to move the whole finger through a tendon. A hole in the rigid link allows the passage of 
the cable (polyethylene dyneema fiber, Japan) which is used to realize the tendon driven actuation. The 
tendon wire runs through the finger and is attached on one side to the fingertip and on the other to the 
shaft of the actuator. Due to flexible parts in the joints, the device is passively compliant. Reasons for 
adding passive elements are manifold, including avoiding tendon slackness and ensuring the uniqueness of 
the position [91] . The built-in compliant nature of the extra-finger increases its ability to grasp different 
objects. The support base of the finger is realized in ABS. It contains the actuator and an elastic band that 
allows the user to wear the device on the forearm. The structure of the support base is symmetrical, a 
feature that enables the robotic finger to be worn on both the left or right hand of the user without any 
modification in the device. 

The actuator used is a piezo LEGS linear motor (linear twin 207V, PiezoMotor, Swedon) which can 
provide high force output in a very compact body. Principal details on the motor features are reported in 
Table 8.1. It features predictable sub-micron, direct drive motion without backlash with resolution down 
to single nanometer level or below. Lack of gear heads and linear screws reduce the overall size of the 
motor. It can deliver up to 20 TV force. The drive technology is direct, meaning no gears or lead screws are 
needed to create linear motion. The motor has no mechanical play or backlash. 

The Piezo LEGS walking principle is of the non-resonant type, i.e. the position of the drive legs is 
known at any given moment. This assures very good control of the motion over the whole speed range. 
The performance of a Piezo LEGS motor is different from that of a DC or stepper motor in several aspects. 
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Table 8.1: The MRI compatible supernumerary robotic finger technical details 


Phalange dimensions 

2.0 x 3.1 x 1.2 cm 3 

Support base dimensions 

6.4 x 7.0 x 0.35 cm 3 

Total weight: finger + support base 

140 g 

Actuator maximum stroke 

80 mm 

Actuator speed range 

0 — 10 mm/s 

Actuator stall force 

20 N 

Actuator dimensions 

22 x 21 x 10.8 mm 3 

Actuator weight 

29 g 

Control 

Hand-held driver (PMCM21) 


A Piezo LEGS motor is friction based, meaning the motion is transferred through contact friction between 
the drive leg and the drive rod. The controller used is hand-held driver PMCM21 (PiezoMotor, Swedon) 
which is a simple hand-held push-button driver for Piezo LEGS motors that offers sub-micron resolution 
linear motion. Pushing the button to move in one direction ramps up speed by utilizing phase-shifting of 
the drive signal. A quick press of the button generates sub-micron steps. 


8.3 MRI non magnetic compatible supernumerary robotic finger 

The non magnetic compatible supernumerary robotic finger as shown in Fig. 8.2 is composed by four 
one-DoF modules. Each module consists of a servomotor (HS-53 Microservo, HiTech, Republic of Korea), 
a 3D printed plastic part (acrylonitrile butadiene styrene, ABSPlus, Stratasys, USA) and a soft rubber part 
used to increase the friction at the contact area. 



Figure 8.2: The non MRI compatible supernumerary robotic finger. The device exploded CAD view and prototype are 
shown. It can be worn on the forearm thanks to an elastic band. When activated, it interacts with the hand in grasping 
tasks. 


The modular part of the finger is connected to a support base which contains also the electronic housing. 
An elastic band allows to easily wear the device on the forearm. An external battery is used to provide 
power to all the circuits. All the electronics is enclosed in a 3D printed box attached to the support base to 
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Table 8.2: MRI non-compatible supernumerary robotic finger technical details 


Module dimension 

42 x 33 x 20 mm 3 

Support base dimension 

78 x 24 x 5 mm 3 

Module weight 

8g 

Support base weight 

18 g 

Max torque per motor 

0.15 Nm 

Stall current 

440 mA 

Velocity of one module 

0.2 rad/s 

Device external batteries 

7.5 V, 2.2 Ah 

Continuous operating time 

3.5 h (@stall torque) 

Max device payload 

610 g 


preserve the extra-finger wearability. The module actuators are PWM controlled servomotors. The PWM 
signals are generated by an Arduino Nano board [76]. One of the major challenge in augmenting the human 
hand capabilities through supernumerary robotic fingers lies in developing a suitable control interface 
and in designing algorithms for seamless integration of device motion with that of human hand. In [16], 
we presented a mapping algorithm able to transfer to an arbitrary number of the robotic extra-fingers the 
motion of the human hand. We used the same algorithm to control the motion supernumerary robotic 
finger in coordination with human hand. The Cyberglove III System [60] is used to track the human hand. 
The dataglove and robotic finger controller are connected through serial ports with a computer running the 
mapping algorithm. 

8.4 Experiments 

Training 

Nine right-handed healthy subjects (males; mean age range 30-35 years) took part into the training that 
involved the use of supernumerary robotic finger in activity of daily living (ADL) tasks. The training 
period consisted in 2 days, four hours per day. The training tasks comprised an extensive practice in 
grasping target objects of different sizes and shapes (e.g., box, dice, cylinder) with the augmented hand 
to evaluate the effectiveness of the extra robotic finger in enlarging the human hand workspace and its 
dexterity. Participants also performed manipulation tasks that usually involve both hands. Fig. 8.3 shows 
examples of motor tasks performed with the help of the supernumerary robotic finger using the sensorized 
glove. Note that in Fig. 3-a, the supernumerary finger is used in coordination with the little and ring finger, 
while in the other two examples, the robotic finger is used in coordination with the whole hand to hold 
large size objects. To this aim, the agent fully opens his hand and the extra finger comes in the middle of 
the human hand with all the joints fully extended. After that, once the human hand moves to grasp the 
object, the extra-finger movement is coordinated with the movement of the real fingers. Of note, all the 
tasks are either anatomically and physiologically impossible or at least very difficult to be carried out with 
a single hand. The augmented hand is able to grasp larger size objects, which are impossible to be grasped 
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(a) Opening the bottle. 


(b) Grasping bigger size box 



(c) Grasping dice 


(d) Grasping bigger size cylinder 


Figure 8.3: Examples of tasks performed during the training with the supernumerary robotic finger. 


if the hand is unaided. 


MRI data acquisition 



Figure 8.4: The experimental fMRI setup:The subject is using MRI compatible finger inside the fMRI scanner. 

Participants performed three different experimental sessions: one before the beginning and one at the 
end of the two days training period. Immediately after the second (post-training) session, subjects per¬ 
formed a third fMRI acquisition using the MR-compatible device inside the scanner. For the three sessions, 
a common experimental paradigm, involving a simple finger-tapping task, was adopted: participants had 
to tap their fingers (from II to V) against the thumb, with a frequency of about 1 Hz, for 20 seconds. The 
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blocks were interleaved with a resting period of 20 seconds. The task blocks were performed in a fixed 
order (II-III-IV-V) and the total duration of each run was 3 minutes (m) 40 seconds(s), including two 
20s-long rest periods at the beginning and at the end. Four runs were performed, with the right hand (odd 
runs) and left hand (even runs), respectively. Immediately after the second (post-training) session, subjects 
performed a third acquisition using the MR compatible device for both hands. 

Methods 

Data were acquired on a Philips 1.5 Tesla Intera scanner, equipped with a 16 channels head coil. Functional 
runs (Gradient Echo EPI) were acquired using these parameters: Field-Of-View 218x218 mm, matrix 
128x128, voxel size 1.7x1.7x3 mm, axial acquisition, 80 volumes, 23 slices, Repetition Time: 2.5 s, 
Echo Time: 40 ms; Flip Angle: 30. The volume of interest included the primary motor, somatosensory 
and parietal areas. Additional whole brain structural images (3D T1-weighted) were acquired (matrix 
256x256x150, voxel size 1 mm 3 , axial acquisition, Repetition Time: 30 ms, Echo Time: 30 ms; Flip 
Angle: 40. A T2 weighted Turbo Fluid Attenuated Inversion Recovery (FLAIR) 3-mm thick axial image 
was also acquired to ensure no participants display brain lesions. 

Data from the post-training session of one subject and from the session with the MR compatible 
device of three subjects were discarded for acquisition problems and excessive head motion, respectively. 
Functional MRI data were analyzed with the AFNI and FSL software packages [162, 163]. Preprocessing 
included slice timing correction, spike removal, motion correction, estimation of motion outliers (fsl motion 
outliers), threshold 6 mm [164], spatial smoothing (FWHM 5 mm) and normalization of time series. Later, 
a multiple linear regression with a model for the temporal autocorrelation of fMRI time series (ARMA 1,1) 
was used to estimate the BOLD responses for each task block. The hemodynamic responses for each block 
(i.e., each digit) were modeled individually as regressors of interest, while polynomial trends, motion 
parameters and spikes were modeled as regressors of no-interest. Structural images were transformed to 
MNI152 space with a nonlinear registration method (3dQwarp) and the resulting matrix was also applied 
to register the t-score maps from the functional data. Two separate group analyses were performed, to 
evaluate the impact of the training and to evaluate the brain regions that are active during the usage of the 
MR-compatible supernumerary robotic finger. For the pre-and post-training sessions, coefficients were 
analyzed with a 3-way analysis of variance (ANOVA), with session (pre- and post-training) and digits 
(II to V) as fixed factors. For the session with the MR compatible device, data were analyzed through a 
one-sample Mixed Effect Meta-Analysis (MEMA). Cluster correction was applied to all the fMRI results 
using Monte Carlo simulations (3dClustSim, 10,000 iterations). The minimum cluster size for a corrected 
p-value of 0.05 was 166 voxels. 

8.5 Results and discussion 

In this study, we presented a novel MR compatible finger together with preliminary fMRI results. MR 
compatibility needs a set of supplementary constraints in the material and actuator which needs a proper 
design and development process. The common standard material and mechanical parts cannot be used in 
magnetic resonance environment because they usually contain ferromagnetic components. Majority of the 
actuators are electromagnetic devices and practically impossible to use during imaging. We realized the 
MRI compatible finger by using suitable materials and actuator. In particular, the device is 3D printed 
by using ABS and thermoplastic polyurethane (TPU) material and actuator used is a piezoelectric motor 
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Post-training 
2.36 | 5.2 

T-score 


Figure 8.5: Pre V/s post trainging contract (ANOVA). 



2.07 


6.5 


T-score 


Figure 8.6: The brain region activated during the task with the MRI compatible finger 


with non-magnetic housing. The ABS parts act as rigid phalanges and TPU parts play the role of flexible 
joints. The flexible joints slides inside the rigid link which makes the assembling process of all the parts 
easy and without any screws or other metal passive elements in the joints. The actuation system of the 
finger is based on cable driven and underactuation. We used the device in fMRI experiments outlined in 
this study. The usage of the MRI compatible supernumerary finger was safe inside the scanner, and, just 
relying on a qualitative assessment of the functional response maps during a motor task, appeared not 
induce any artifact in MRI reconstruction of the brain. We also presented the MRI non-compatible finger 
version which is a modular 3D printed structure where each module is composed of a rigid link and a 
servo motor. The motion of both devices can be controlled by their control interfaces presented in this 
chapter. Developing a suitable strategy for controlling an extra limb, whether it is a finger or an arm, is 
of high interest for various fields: for example, in [39] authors studied how a surgeon can use his foot to 
control an extra arm, at least in a virtual environment. Since it is important that the operator keeps focused 
on the task he has to perform, the control paradigm of the robot should be felt natural to him, as if the 
supernumerary limb was part of his body. 

In this preliminary fMRI study for supernumerary fingers, greater neural responses for the post-training, 
as compared to the pre-training condition, were found in a network of brain regions including bilateral 
cingulate cortex, bilateral superior parietal lobule, left inferior parietal lobule and right middle frontal 
gyrus (see figure 8.5). Task-related use of the magnetic compatible supernumerary finger inside the scanner 
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activated a bilateral network of sensorimotor regions, including bilateral primary motor and primary 
somatosensory areas and supplementary motors areas (SMA) (see Figure 8.6). 

The two day training with extra robotic finger did not induce detectable modifications in the resting 
state activity of primary sensorimotor areas. This can be due to the small sample size or to the adoption of 
different tasks for the training (i.e., anatomically impossible grasping gestures) and the fMRI experiment 
(i.e., a simple finger-to-finger opposition task). Future work should employ a different paradigm for fMRI, 
with a task involving finalized hand gestures inside the scanner, in order to evaluate the newly acquired 
motor synergies and their similarity to physiological ones. Activity changes in supplementary motor areas 
are linked to motor training, even for short periods [165], and it is not surprising to find an enhanced 
activity of this region. The differences in superior parietal activations (Fig. 8.5) could be explained with 
modification in space representation induced by the device, while the results in the left inferior parietal 
cortex may be driven by the practice with the supernumerary finger, used as a tool [166]. 

Even if the neuroscientific results are preliminary, mainly due to the small sample size, they suggest 
that the magnetic compatible supernumerary finger can be safely used inside the scanner, to assess the 
neural correlates of the rehabilitation with the supernumerary robotic finger use in stroke patients [30], 
providing the brain functional and structural counterparts of the improvement of everyday life activities 
which has been observed in previous behavioral experiments. They represent a first, original, step toward a 
better understanding of brain correlates of the extra finger’s use and of the relationship between extra-limbs 
and their eventual embodiment processes. 


8.6 Conclusions and future work 

The new generation supernumerary robotic limbs is a rapidly growing field and represents a challenging 
area of research which aims at, adding robotic limbs to human to augment the manipulation abilities of 
natural limbs. In this direction, an interesting yet challenging issue needs to be addressed, that is: how the 
human cognitive system perceives, the use of supernumerary robotic limbs. This goal passes through the 
investigation of brain functional changes due to the use of robotic extra limbs. In this chpater, we presented 
the design and development of our supernumerary robotic fingers having main focus on the new MRI 
compatible finger. We successfully acquired the fMRI data even in the presence of MRI compatible robotic 
finger without any artifact in MRI reconstruction of the brain. In future, we are planning to add more 
degree of freedom in the design of robotic finger to improve its manipulation capabilities. The current 
study on healthy subjects is a necessary step before the investigation of neural correlates of robotic extra 
fingers’ use in stroke patients, where the supernumerary finger has been already successful for improving 
everyday patients’ life activities [2]. 

The task related use of the magnetic compatible supernumerary finger inside the scanner activated the 
same motor network recruited by fully physiolocial voluntary motor gestures (see, Fig. 8.6), thus implying 
that the use of the supernumerary robotic finger does not require the acquisition of additional skills or 
abilities. This justifies the easiness and immediacy of use of the extra robotic finger in stroke patients 
for grasping [30]. Future studies should better disentangle relationships between this brain activity and 
behavioual outcomes. Even though, the present results must be considered preliminary, they allow to 
affirm that the proposed magnetic compatible supernumerary robotic finger is safe even for the use inside 
the scanner and it does not alter the quality of brain images. This study represents a first, original, step 
toward a better understanding of brain correlates of the extra robotic finger’s use and of the relationship 
between extra-limbs and their eventual embodiment processes. 
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Chapter 9 


This thesis presents my contribution to the foundation of a new era of robotic extra-limbs, collecting all 
the work I have done toward my Ph.D. degree at the University of Siena. The focus of this research was on 
augmenting and compensating the human manipulation abilities through supernumerary robotic fingers. 
During these years, I investigated through various studies involving the robotics, biomechanics, human 
factors and control theory methods to develop new generation of supernumerary robotic fingers along 
with their customized control interfaces. The guiding principles of the robotic devices design are safety, 
wearability, ergonomics and user comfort. 

The thesis presented in chapter 1 an introduction to the supernumerary robotic fingers and state of 
the art. It illustrated how the research on the supernumerary robotic limbs is different in nature than the 
existing approaches of assistive devices. This was followed by a literature review on extra robotic fingers. 
It was understood that it’s a newly introduced field which is extending its horizon from compensation 
to augmentation and enhacment of human manipulation abilities. The challanges lie in designing these 
robotic devices to fullfill the ergonomics and functional requirements as well as their integration with 
human body. 

Chapter 2 has presented the design of extra robotic fingers to enhance the abilities of human hand to 
increase its work space and manipulation abilities. It proposed the different design guidelines both for 
fullyactuated and underactuated robotic extra-finges that can be integrated with human hand to enhance 
its manipulation abilities. Such guidelines were followed for the realization of three prototypes obtained 
using rapid prototyping techniques, i.e., a 3D printer and an open hardware development platform. Both 
fully actuated and underactuated solutions have been explored. To control the motion of the robotic fingers, 
we presented mapping algorithm able to transfer to the extra-fingers a part or the whole motion of the 
human hand. The mapping algorithm was based on the definition of a virtual object obtained as a function 
of a set of reference points placed on the augmented hand (human hand and robotic fingers). When the 
human hand fingers were moved, the virtual object was moved and deformed. The robotic extra-fingers 
were then actuated so that the reference points on them followed the same transformation. Although, 
The mapping algorithm allowed to move the extra-fingers according to the human hand motions without 
requiring explicit command by the user but it has some limitations too. This mapping approach required 
an instrumented glove to track the human hand which affect its practical application specially with stroke 
patients. Patients with a paretic hand cannot properly control finger motions, thus a dataglove interface 
cannot be used. The estimation of the human hand posture and fingers motion implies a reliable and 
computationally expensive hand tracking. Moreover, there is no feedback of the amount of the forces 
applied by the robotic finger on the grasped object and its status. 

To overcome these limitation, in chapter 5 the wearable sensory motor interfaces for supernumerary 
robotic fingers are presenetd. In particular, two kinds of interfaces namely ’’vibrotactile ring” and hRing 
are proposed. The human user is able to control the motion of the robotic finger through trigger signals 
generated by a switch placed on the rings, while being provided with cutaneous feedback about the forces 
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exerted by the robotic finger on the environment. A trigger based control approach can dramatically 
simplifies the interaction with the extra robotic finger, reducing it to the activation of a grasping procedure 
through the trigger signal activated by a wearable switch placed on a ring. A single switch activation 
regulated the stop/motion of the finger along a predefined flexion trajectory, while a double activation 
switched from flexion to extension and viceversa. Although, the ring based control approach resulted 
simple and intuitive, this control interface involved human hand thumb. Thus limiting the use of thumb in 
completion of tasks. Moreover, it offers few user control inputs to control the motion of the robotic finger 
and force control is not straightforward. 

Chapter 3 presents how the superumerary robbotic finger can be used to compensate the missing 
abilities on impaired upper limb in chronic stroke patients. The robotic finger and paretic limb act as 
two parts of a gripper to grasp and hold the object. With the use of supernumerary robotic fingers, It’s 
expected to increase patients’ performances, with a focus on objects manipulation, thereby improving 
their independence in ADL, and simultaneously decreasing erroneous compensatory motor strategies for 
solving everyday tasks. The patient was control the motion of the robotic finger using an EMG interface 
through frantalis muscles. 

The use of preliminary prototype of the robotic finger helped us in understanding the potential of 
the approach in case of stroke patients and extracting the ergonomics and functional requirements. The 
fully actuated structure allows the robotic finger to actively shape around an object, but the resulting 
size and weight affect the device portability, wearability and robustness. For these reasons, we proposed 
soft and underactuated robotic fingers. In particular, chapter 4 presents the design, analysis, fabrication, 
experimental characterization and evaluation of two prototypes of soft supernumerary robotic fingers 
that can be used as grasp compensatory devices for hemiparetic upper limb. We proposed a method to 
compute the stiffness of flexible joints and its realization in order to let the fingers track a certain predefined 
trajectory. We referred to tendon driven, underactuated and passively compliant fingers composed of 
deformable joints and rigid links. The finger joints can be given specific stiffness and pre-form shapes 
such that a single cable actuation can be used. We define firstly a procedure to determine suitable joints 
stiffness and then we propose a possible realization in robotics fingers hardware structure. The stiffness 
computation is obtained leveraging on the the mechanics of tendon-driven hands and on compliant systems, 
while for its implementation beam theory has been exploited. We validate the proposed framework both in 
simulation and with experiments using a prototypes of the devices. 

In chapter 6 two kinds of electromyographic (EMG) control interfaces for supernumerary robotic 
fingers are presented. In particular, frontalis muscle cap and arm EMG interface. The former is more 
suitable for underactuated soft fingers while the later is developed to control the motion and compliance of 
fully actuated robotic finger. In frontalis muscle cap the electrodes and acquisition boards are embedded in 
cap which allows the user to control the device motion through wireless communication by contracting the 
frontalis muscle. 

Chapter 7 presents the combination of soft extra finger with the arm support to provide the needed 
assistance during paretic upper limb rehabilitation involving both grasping and arm mobility to solve 
task-oriented activities. The proposed system has been designed to be used during the rehabilitation phase 
when the arm is potentially able to recover its functionality, but the hand is still not able to perform a 
grasp due to the lack of an efficient thumb opposition. The overall system also act as a motivation tool 
for the patients to perform task-oriented rehabilitation activities. Finally, Chapter 8 presents a magnetic 
compatible supernumerary robotic finger for functional magnetic resonance imaging (fMRI) acquisitions 
along with preliminary results on embodiment of supernumerary robotic finger. 

Currently, we are investigating whether it is possible to introduce the robotic extra fingers in early 
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rehabilitation phase. Many of the rehabilitation strategies involve ADL tasks where patients attempt to 
make use of weak hand even though it is not functionally capable. This can result in feelings of frustration. 
Presenting an active compensatory tool may help in the initial phase to promote the use of the arm even 
if the hand grasp function is not recovered. Furthermore, hemiparetic patients also face challenges in 
completing many bimanual tasks which are crucial to their independence and quality of life , some of 
examples are shown in this thesis. Additional opportunities for these robotic devices include patient 
monitored rehabilitation training that can be done at home and direct ADL assistance for those with 
minimal hand functionality. For example, some studies in literature claim that rehabilitation in chronic 
stages should focus on learning adaptive processes either through more difficult bi-manual activities or 
through the forced use of the affected limb [167]. In this regard, the patients can use their muscles abilities 
effectively to complete the bi-manual task, while exploiting only minimal assistance by the robotic devices 
needed to complete the tasks. Moreover, clinical team could develop new protocols and scenarios for 
the involvement of such robotic compensatory devices, while monitoring the patients improvements on 
regular basis. The patient could exercise the impaired arm by positioning the grasp compensatory device 
next to the object, trying to contribute in grasping to the maximum extent of their abilities. This would 
motivate the patient to attempt the bi-manual tasks and minimize the feelings of failure that may arise 
when attempting to complete tasks beyond their current capability. This could help the patient to eventually 
regain the ability to complete these tasks on their own. The patient may benefit in the short term with 
the increased feelings of independence, while simultaneously working toward the long term goals of 
rehabilitation. 

In future, we will also explore the possible use of the supernumerary robotic fingers during the 
rehabilitation phase, possibly integrating them with other state-of-the-art assistive devices used for hand 
rehabilitation, e.g. orthoses and functional electrical stimulation (FES). In a possible hand rehabilitation 
scenario, an object could be connected to the tip of the finger and actively moved with respect to the palm 
of the patients impaired hand. Thus, while the user is trying to stabilize the grasp, the robotic finger will 
have the aim of destabilizing it. Challenging grasping exercises like this, will stimulate movements of the 
impaired hand, possibly achieving a rehabilitative effect. 

we are also exploring the possibility of using our devices in patients affected by other neurological 
diseases possibly affecting hand grasping, such as Multiple Sclerosis, Amyotrophic Lateral Sclerosis and 
paresis due to cervical spinal cord lesions. 

We are further exploring neural embodiment of supernumerary robotic fingers but this study is still at 
preliminary stage. 
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